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For  a sequence  of  random  elements  {Vn,  n > 1}  in  a real  separable  Banach  space 
A,  sufficient  conditions  are  provided  for  the  strong  law  of  large  numbers  X^Li(Vj  ~ 
Ci)/bn  — > 0 almost  certainly  to  hold  where  {c„,ra  > 1}  and  {bn  > 0,  n > 1}  are 
suitable  sequences  of  centering  elements  in  X and  norming  constants,  respectively. 

In  the  case  of  independent  random  elements,  separate  necessary  conditions  are 
also  provided  for  a strong  law  of  large  numbers.  The  necessity  result  extends  a real 
line  result  of  Martikainen  to  a Banach  space  setting.  The  sufficiency  results  in  the  case 
of  independent  summands  are  new  even  when  X is  the  real  line  and  are  divided  into 
two  categories.  The  first  assumes  that  X is  of  Rademacher  type  p (1  < p < 2).  The 
result  is  general  enough  to  include  as  special  cases  a strong  law  of  Adler,  Rosalsky, 
and  Taylor  for  sums  of  independent  and  identically  distributed  random  elements  and 
a strong  law  of  Heyde  for  sums  of  independent  (real- valued)  random  variables.  The 
second  imposes  no  conditions  on  the  underlying  Banach  space;  instead,  it  assumes 
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that  the  sequence  of  random  elements  is  compactly  uniformly  integrable.  The  result 
includes  as  special  cases  a strong  law  of  Adler,  Rosalsky,  and  Taylor  for  compactly 
uniformly  integrable  sequences  and  a strong  law  of  Taylor  and  Wei  for  uniformly  tight 
sequences. 

Strong  laws  are  also  provided  where  no  conditions  are  imposed  on  the  joint 
distributions  of  the  random  elements  or  on  the  underlying  Banach  space,  and  these 
results  are  new  even  when  the  Banach  space  is  the  real  line. 

Illustrative  examples  are  provided  which  compare  the  results  or  which  show  how 
the  results  improve  upon  or  are  different  from  other  results  in  the  literature.  Examples 
are  also  provided  which  show  that  the  results  are  sharp. 
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CHAPTER  1 
INTRODUCTION 


The  history  and  literature  of  investigation  on  laws  of  large  numbers  are  vast 
and  rich,  as  this  concept  is  crucial  in  probability  and  statistical  theory  and  in  their 
application.  There  is  nothing  more  fundamental  to  the  very  foundation  of  statistical 
science  than  the  laws  of  large  numbers.  It  is  the  laws  of  large  numbers  which  elucidate 
the  notion  that  probability  is  a limiting  relative  frequency  and  hence  the  laws  of  large 
numbers  provide  justification  for  Kolmogorov’s  (1933)  axiomatic  theory  of  probability 
being  a physically  realistic  subject.  Indeed,  the  laws  of  large  numbers  provide  a rig- 
orous formulation  and  justification  for  the  notion  that  “the  sample  mean  approaches 
the  population  mean  as  the  sample  size  approaches  infinity”  (i.e.,  the  sample  mean  is 
a consistent  estimator  of  the  population  mean).  It  is  the  area  of  consistency  wherein 
the  laws  of  large  numbers  have  many  applications. 

The  first  theorem  on  the  law  of  large  numbers,  due  to  Bernoulli  in  the  late  1600’s, 
was  the  weak  law  of  large  numbers  (WLLN)  for  Bernoulli  trials  which  states  that  if 
Sn  is  the  number  of  successes  observed  in  n independent  identical  trials  with  success 
probability  p in  each  trial,  then  Sn/n  — » p in  probability  as  n — > oo.  Bernoulli’s 
result  was  touted  by  Kolmogorov  in  1986  as  the  beginning  of  probability  proper  (see 
Bingham  (1989)).  After  Lebesgue’s  work  on  measure  theory  in  the  early  1900’s,  the 
(first)  strong  law  of  large  numbers  (SLLN)  could  be  formulated.  The  first  of  such 
SLLNs  is  credited  to  Borel  (1909)  and  is  the  extension  of  Bernoulli’s  result  from 
convergence  in  probability  to  convergence  with  probability  one  (or  almost  certain 
(a.c.)  convergence).  It  is  interesting  to  observe  that  there  was  over  a two  hundred 
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year  gap  between  this  SLLN  and  its  earlier  WLLN  counterpart.  Cantelli  (1917)  is 
credited  with  the  first  SLLN  regarding  the  a.c.  convergence  of  the  sample  mean  to 
the  population  mean  (see  Seneta  (1992)). 

The  laws  of  large  numbers  provide  the  consistency  of  many  estimators  including 
numerous  common  statistics  (such  as,  of  course,  the  sample  mean),  as  well  as  for 
estimates  found  by  Monte  Carlo  simulation.  Many  of  these  concepts  and  applications 
can  be  extended.  Interesting  applications  of  SLLNs  also  occur  in  physics  and  com- 
puter science.  The  field  of  ergodic  theory,  which  lies  at  the  interface  of  probability 
theory  and  statistical  physics,  has  as  its  foundation  the  SLLN  type  result  provided  by 
the  Birkoff-Khintchine-von  Neumann  pointwise  ergodic  theorem  (see,  e.g.,  Breiman 
(1968,  Chapter  6)  or  Stout  (1974,  Section  3.5)).  This  result  gives  conditions  for  an 
“ensemble  average”  to  be  estimated  by  a “time  average.”  A SLLN  was  derived  by 
Wehr  (1997)  with  applications  to  random  resistor  networks  and  the  durability  of  com- 
posite fibers.  Other  applications  of  the  SLLN  to  resistance  can  be  found  in  Essoh  and 
Bellissard  (1989).  Another  interesting  and  “non-statistical”  application  occurs  in  the 
field  of  number  theory  in  the  investigation  of  normal  numbers  x € [0, 1]  (see  Revesz 
(1968,  pp.  151-157)). 

The  primary  objective  of  the  current  work  is  to  investigate  conditions  under 
which  the  SLLN  for  independent  Banach  space  valued  random  elements  obtains, 
although  some  results  will  be  presented  for  which  the  assumption  of  independence  is 
not  needed.  Before  discussion  of  this  objective  some  notation  and  definitions  must 
be  introduced. 

Let  A"  be  a linear  space  over  M;  that  is,  A”  is  a vector  space  over  M.  Let  ||  • ||  : 
X -*  [0,  oo ) be  a function  satisfying  the  following  three  properties: 


(i)  For  v 6 X,  ||v||  = 0 if  and  only  if  v — 0. 
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(ii)  ||av||  = |a||M|  for  all  v G A and  a G M. 

(Hi)  ||«i  + W2II  < IKII  + 1 1 ^2 1 1 for  all  vuv2  G A. 

The  function  ||  • ||  is  called  a norm  on  A,  and  X is  then  said  to  be  a real  normed 
linear  space  (with  norm  ||  ■ ||). 

A sequence  {vn,  n > 1}  in  A is  said  to  converge  to  v G X if  lim^oo  ||un  — v||  = 0. 
A real  normed  linear  space  is  said  to  be  complete  if  every  Cauchy  sequence  in  X 
converges  to  a member  of  X.  (A  Cauchy  sequence  in  X is,  of  course,  a sequence 
{vn,  n > 1}  in  X such  that 

lim  |K  - i>m||  = 0.) 

n— >00 
m— >00 

A real  normed  linear  space  X which  is  complete  is  said  to  be  a real  Banach  space.  A 
real  Banach  space  is  said  to  be  separable  if  it  contains  a countable  dense  subset. 

Let  (f2,  P,  P)  be  a probability  space,  let  A be  a real  separable  Banach  space  with 
norm  ||  • ||,  and  let  X be  equipped  with  its  Borel  cr-algebra  B ; that  is,  B is  the  a- 
algebra  generated  by  the  class  of  open  subsets  of  X determined  by  1 1 ■ 1 1 via  the  metric 
d(vi,v2)  = |K  — v2\\,  Vi,v2  G X.  A random  element  A in  A is  an  JF-measurable 
transformation  from  12  to  the  measurable  space  (A ,B).  The  expected  value  or  mean 
of  A,  denoted  E A,  is  defined  to  be  the  Pettis  integral  provided  it  exists;  that  is,  A has 
expected  value  EV  in  A if  L(EV)  = E(L( A))  for  every  L in  X*  where  A*  denotes 
the  (dual)  space  of  all  continuous  linear  functionals  on  A.  We  recall  that  a linear 
functional  is  a function  L : A -4  E satisfying  L(av  + bw)  = aL(v)  + bL(w)  for  all 
v,w  G A and  all  a,  6 G M.  Of  course,  a linear  functional  L is  continuous  if  whenever 
{vn,  n > 1}  is  a sequence  in  A with  vn  -»  v G A we  have  L(v„)  -»  L(v ).  A sufficient 
condition  for  EV  to  exist  is  that  £||A||  < 00  (see,  e.g.,  Taylor  (1978,  p.  40)).  A 
complete  characterization  of  when  the  Pettis  integral  exists  was  provided  by  Brooks 
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(1969).  See  Hille  and  Phillips  (1957,  pp.  76-85)  for  further  discussion  and  details 
regarding  the  properties  of  the  Pettis  integral. 

An  example  illustrating  expectation  in  Banach  spaces  follows:  Let  1 < p < 
oo  and  X = CP(M.)  where,  as  usual,  this  denotes  the  class  of  Lebesgue  measurable 
functions  /:  R — >•  R such  that  fR  |/(x)|p  dx  < oo  where  the  norm  is  defined  by 
||/||  = I fp  \f(x)\p  dx)  . This  class  is  a Banach  space  according  to  the  famous 
Riesz-Fischer  theorem  (see,  for  example,  Royden  (1988,  p.  125)).  For  fixed  fo  E X 
and  integrable  random  variables  X and  Y , define  the  random  element  V = A”/o  + Y. 
We  claim  that  EV  = E(X)fo  + E(Y).  To  verify  this,  note  that  for  any  L E X *, 
we  have  L(E(X)f0  + E(Y))  = E(X)L(f0)  + E(Y)L(  1)  = E(XL(f0))  + E(YL(  1))  = 
E(XL(f0 ) + YL{  1))  = E(L{Xf0  + Y))  = E{L{V))  and  thus  the  candidate  EV  = 
E(X)fo+E(Y)  satisfies  the  defining  property  L(EV)  = E(L(V)).  We  remark  that  the 
dual  space  X*  can  be  completely  characterized  for  this  example.  For  every  g E £g(M) 
where  q — ^ (1  < q < oo),  the  functional  L defined  by 

L{f)  = [ f{x)g(x)  dx  (/  € Cp)  (1.1) 

Jr 

is  in  X*  (see,  e.g.,  Royden  (1988,  p.  131)).  Conversely,  the  famous  Riesz  Represen- 
tation Theorem  (see,  e.g.,  Royden  (1988,  p.  132))  asserts  that  every  L E X*  is  of  the 
form  (1.1)  for  some  function  g E £,(M)  where  q = (1  < q < oo).  The  function  g 

is  unique  up  to  sets  of  Lebesgue  measure  0. 

Let  n > 1}  be  a symmetric  Bernoulli  sequence ; that  is,  {F„,  n > 1} 

is  a sequence  of  independent  and  identically  distributed  (i.i.d.)  random  variables 
with  P{Y{  = 1}  = P{YX  = -1}  = 1/2.  Let  X°°  = X x X x X x ■ • • and  define 
C(X)  = {(vi,v2, . . . ) E X°°  : Y^=iYnvn  converges  in  probability}.  Let  1 < p < 2. 
Then  X is  said  to  be  of  Rademacher  type  p if  there  exists  a constant  0 < C < oo 
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such  that 


E 


OO 


n=l 


P 


IKIIP  for  a11  («i, «*,-••)  € C(X). 

n-l 


It  should  be  pointed  out  that  the  condition  that  the  series  Y„vn  converges 

in  probability  is  equivalent  to  the  condition  that  the  series  Ynvn  converges  a.c. 

Indeed,  Ito  and  Nisio  (1968)  proved  that  a series  of  independent  random  elements 
converges  in  probability  if  and  only  if  it  converges  a.c.  thereby  extending  the  cele- 
brated theorem  of  Levy  (see,  e.g.,  Chow  and  Teicher  (1997,  p.  72))  from  the  real  line 
to  Banach  spaces. 

Hoffmann- Jprgensen  and  Pisier  (1976)  proved  for  1 < p < 2 that  a real  separable 
Banach  space  is  of  Rademacher  type  p if  and  only  if  there  exists  a constant  0 < C < oo 
such  that 


E 


«=i 


i- 1 


(1-2) 


for  every  finite  collection  {Pi,  - • • ,Vn}  of  independent  random  elements  with  EV{  = 
0,  1 < f < n.  Other  characterizations  of  a Banach  space  being  of  Rademacher  type 
p are  provided  by  Woyczyriski  (1978). 

If  a real  separable  Banach  space  is  of  Rademacher  type  p for  some  1 < p < 2, 
then  it  is  of  Rademacher  type  q for  all  1 < q < p.  Every  real  separable  Banach  space  is 
of  Rademacher  type  (at  least)  1 while  the  £p-spaces  and  ^-spaces  are  of  Rademacher 
type  min{2,p}  for  p > 1.  (See  Woyczynski  (1978,  pp.  343-353)  for  details  and  a 
thorough  discussion.)  Every  real  separable  Hilbert  space  and  real  separable  finite- 
dimensional Banach  space  is  of  Rademacher  type  2 (see  Pisier  (1986)).  In  particular, 
the  real  line  IR  is  of  Rademacher  type  2. 
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A sequence  of  random  elements  { Vn , n > 1}  is  said  to  be  compactly  uniformly 
integrable  if  for  every  e > 0,  there  exists  a compact  subset  Ke  of  X such  that 

supE\\VnI(VntKe)\\<e. 

n>  1 

A sequence  of  random  elements  being  compactly  uniformly  integrable  is  the  natural 
extension  of  a sequence  of  (real-valued)  random  variables  being  uniformly  integrable 
in  that  the  two  definitions  are  equivalent  when  the  Banach  space  is  the  real  line. 

A sequence  of  random  elements  {K,,  n > 1}  is  said  to  be  uniformly  tight  if  for 
every  e > 0,  there  exists  a compact  subset  Ke  of  X such  that  supn>1  P{Vn  £ Ke)  < e. 
It  was  shown  by  Daffer  and  Taylor  (1982)  that  compact  uniform  integrability  implies 
uniform  tightness.  Cuesta  and  Mat  ran  (1988)  remarked  that  if  {Vn,  n > 1}  is 
compactly  uniformly  integrable,  then  {||K||,  n > 1}  is  uniformly  integrable.  Cuesta 
and  Matran  (1988)  also  remarked  that  {||VJ,||,  n > 1}  being  uniformly  integrable 
together  with  {1^,  n > 1}  being  uniformly  tight  imply  that  {Fn,  n > 1}  is  compactly 
uniformly  integrable.  Consequently,  {V^,,  n > 1}  is  compactly  uniformly  integrable 
if  and  only  if  {Vn,  n > 1}  is  uniformly  tight  and  {||K,||,  n > 1}  is  uniformly 
integrable.  See  Wang  and  Bhaskara  Rao  (1987)  and  Cuesta  and  Matran  (1988)  for 
further  discussion  concerning  the  relationship  between  compact  uniform  integrability 
and  uniform  tightness. 

Let  {Vn,  n > 1}  be  a sequence  of  random  elements  and,  as  usual,  their  partial 

n 

Sn  = Vi,  n>  1. 

i=i 


sums  will  be  denoted  by 
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We  say  that  the  sequence  of  random  elements  {V',,,  n > 1}  obeys  the  strong  law  of 
large  numbers  (SLLN)  with  centering  elements  {C„,  n > 1}  and  norming  constants 
{bn  > 0,  n > 1}  if 


Sn~Cn 


0 a.c. 


(1.3) 


Here  0 denotes  of  course  the  zero  element  of  X and  the  centering  elements  {Cn,  n > 1} 
are  (nonrandom)  members  of  X.  The  SLLN  in  (1.3)  can  of  course  be  expressed  as 

1 " 

— y ~ °i)  -*  0 a-c- 

°n  i=  l 

where  cn  = Cn  - C„_i,  n > 1 taking  C0  = 0 ( ^=1  c«'  = C„,  n > l) . 

The  history  of  the  SLLN  problem  for  random  elements  in  a real  separable  Ba- 
nach space  dates  back  to  the  pioneering  work  of  Mourier  (1953)  (see  Laha  and  Ro- 
hatgi  (1979,  p.  452)  or  Taylor  (1978,  p.  72))  which  established  an  analogue  of  the 
classical  Kolmogorov  SLLN.  Specifically,  Mourier  showed  that  if  {Fn,  n > 1}  are 
i.i.d.  random  elements  in  a real  separable  Banach  space  and  if  EV 1 exists,  then 
EVi)/n  0 a.c.  (For  alternative  proofs  of  Mourier’s  SLLN,  see  Cuesta  and 
Matran  (1986)  and  Adler,  Rosalsky,  and  Taylor  (1989).)  In  the  case  of  i.i.d.  (real- 
valued) random  variables  { Xn , n > 1}  with  E\Xi\  < 00,  the  Kolmogorov  SLLN 
(which  has  norming  constants  b„  = n,  n > 1)  was  generalized  by  Marcinkiewicz  and 
Zygmund  (1937)  when  F'|A1|r  < 00  for  some  0 < r < 2 and  the  norming  constants  are 
= n1/r,  n > 1.  Following  these  results,  Feller  (1946)  in  a famous  article  developed 
a result  for  general  bn.  In  the  case  of  random  elements,  Woyczynski  (1980)  devel- 
oped a Marcinkiewicz-Zygmund  type  SLLN.  (For  some  related  results,  see  Wang  and 
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Bhaskara  Rao  (1987).)  A random  element  version  of  Feller’s  SLLN  which  contains 
Woyczyriski’s  result  was  obtained  by  Adler,  Rosalsky,  and  Taylor  (1989). 

It  should  be  noted  that  many  of  the  Banach  space  SLLN  results  which  are  ob- 
tained in  the  current  work  are  new  results  even  in  the  (real-valued)  random  variable 
case.  However,  some  corollaries  or  special  cases  of  some  of  the  random  element  results 
(and  random  variable  results)  are  well  known  thereby  showing  that  the  current  work 
is  an  extension  of  previously  established  results.  Note  that  we  are  using  the  termi- 
nology random  element  when  the  underlying  Banach  space  X is  general  whereas  we 
are  using  the  terminology  random  variable  when  the  underlying  Banach  space  X is 
the  real  line  R.  (Hence  every  random  variable  is  a random  element  with  X = R.) 

Banach  space  SLLNs  have  applications  to  many  statistical  problems.  In  many 
instances,  it  is  useful  to  regard  a continuous  time  stochastic  process  as  a random 
element  in  a function  space.  This  notion  has  inspired  the  study  of  convergence  of 
random  elements  (see  Taylor  (1978)).  Likewise,  the  natural  extension  of  random 
variable  results  to  random  vector  results  in  multivariate  analysis  also  led  to  the  study 
of  random  elements.  The  consideration  of  a manufacturing  process  as  a random  ele- 
ment (stochastic  process)  provides  an  example  of  the  use  of  the  laws  of  large  numbers 
in  the  estimation  of  the  drift  over  time  for  a continuous  time  stochastic  process  where 
under  various  conditions  the  SLLN  can  provide  the  consistency  of  the  estimate  (see 
Taylor  (1978,  pp.  186-190)).  Taylor  (1978,  pp.  190-201)  also  discusses  applications 
of  the  laws  of  large  numbers  in  Banach  spaces  to  decision  theory,  quality  control,  as 
well  as  estimation  problems  such  as  Monte  Carlo  processes  and  M-estimation.  An 
interesting  example  is  the  extension  of  Monte  Carlo  methods  to  estimating  a solu- 
tion #,  where  9 is  an  element  of  a Banach  space  X using  a sequence  of  estimators 
O n,  n > 1}  where  each  Vn  is  a random  element  in  X with  EVn  = 9 (see  Taylor  (1978, 
pp.  196-197)).  Reeds  (1978)  proved  the  strong  consistency  of  jackknifed  maximum 
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likelihood  estimates  utilizing  a Banach  space  SLLN.  Such  SLLNs  have  also  been  used 
to  prove  the  strong  consistency  of  least  squares  estimates  of  unknown  parameters  in 
multiple  regression  models,  autoregressive  models,  and  time  series  models  (see  Lai, 
Robbins,  and  Wei  (1979),  Chen,  Lai,  and  Wei  (1981),  and  Lai  and  Wei  (1983)). 

Despite  the  fact  that  the  previously  mentioned  applications  of  SLLNs  represent 
extremely  valuable  contributions  to  modern  statistical  practice,  our  objective  in  the 
current  work  does  not  include  application  of  the  SLLNs  presented  herein.  Rather,  our 
objective  is  to  increase  our  understanding  of  the  strong  limiting  behavior  of  random 
sums  with  Banach  space  valued  or  real  valued  summands. 

Often  SLLNs  are  derived  from  results  for  a.c.  convergence  of  series  of  random 
elements  via  the  Kronecker  lemma.  This  lemma  states  that  if  {t>„,  n > 1}  is  a 
sequence  in  X , if  { bn , n > 1}  is  a real  sequence  with  0 < bn  j1  oo,  and  if  ( Vn/K ) 

converges,  then  (X™=i  Vi)/K  — * 0.  Thus  if  {Vn,  n > 1}  is  a sequence  of  random 
elements  and  {c„,  n > 1}  is  a sequence  in  X and  if  Vnfc~Cn  converges  a.c.,  then 

by  the  Kronecker  lemma  the  SLLN  (V)  - cf)  -4  0 a.c.  obtains.  Kolmogorov 

completely  resolved  the  question  of  necessary  and  sufficient  conditions  for  almost 
certain  convergence  of  series  of  independent  random  variables  with  his  celebrated 
three  series  criterion  (see,  e.g.,  Chow  and  Teicher  (1997,  p.  117)).  Thus  in  the  random 
variable  case  many  SLLNs  can  be  obtained  by  applying  the  three  series  criterion  (or 
some  corollary  thereof)  followed  by  the  Kronecker  lemma.  But  it  must  be  realized 
that  the  Kronecker  lemma  approach  yields  a sufficient  but  not  necessary  condition 
for  the  SLLN.  This  approach  was  apparently  first  used  by  Rademacher  (1922). 

It  should  be  pointed  out  that  for  independent  summands  there  is  no  loss  of 
generality  in  only  considering  norming  sequences  {&„,  n > 1}  with  0 < bn  f oo 
(as  opposed  to  0 < bn  — > oo).  Indeed,  in  the  case  of  independent  random  variables 
{A'n,  n > 1},  Martikainen  (1979)  proved  that  {A'n,  n > 1}  obeys  the  SLLN  with 
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norming  constants  {6n,  n > 1}  if  and  only  if  {Xn,  n > 1}  obeys  the  (apparently 
sharper)  SLLN  with  norming  constants  {&*  = infj>n  bj , n > 1}.  In  the  next  chapter  a 
similar  result  will  be  proven  in  the  more  general  case  of  random  elements.  Moreover, 
note  that  for  bn  > 0,  bn  oo  if  and  only  if  6*  = inf;>„  bj  f oo.  Working  with 
monotone  { bn , n > 1}  has  the  added  advantage  that  the  Kronecker  lemma  is  then 
applicable.  Thus  only  monotone  { bn , n > 1}  will  be  considered  when  the  summands 
are  independent. 

Throughout,  it  proves  convenient  to  define  a V b — max{a,  6},  a A b = min{a,  b} 
( a,b  G R)  and  log  a;  = loge(e  Vi),  x > 0 where  loge  denotes  the  logarithm  to  the 
base  e.  The  symbol  [x]  denotes  the  greatest  integer  less  than  or  equal  to  x,  x > 0. 
Moreover,  the  symbol  C denotes  a generic  constant  (0  < C < oo)  which  is  not 
necessarily  the  same  one  in  each  appearance.  Thus,  for  example,  an  expression  such 
as  (2 C2  + l)(n  + n?)  < Cn  is  valid  in  the  current  context. 


CHAPTER  2 

STRONG  LAWS  OF  LARGE  NUMBERS  FOR  SUMS  OF  RANDOM  ELEMENTS 

2.1  Introduction 

At  the  origin  of  the  current  investigation  concerning  the  SLLN  problem 
is  the  following  well-known  result  of  Heyde  (1968)  establishing  a SLLN  for  sums  of 
independent  random  variables. 


Proposition  2.1.1.  (Heyde  (1968))  Let  { Xn , n > 1}  be  a sequence  of  inde- 
pendent random  variables.  If  {&„,  n > 1}  is  a sequence  of  positive  constants  with 
bn  t oo  and 


EE 


< oo, 


(2.1) 


then  the  SLLN 


1 

r Y,  (xi  - E(XiI(\Xi\  < bi)))  ->  0 a.c. 
°n  <= i 7 


obtains. 


(2.2) 


Remark  2.1.1.  As  was  shown  by  Heyde  (1968),  the  condition  (2.1)  is  equivalent 
to  the  pair  of  conditions 

OO 

^P{|A:n|  > bn}  < oo,  (2.3) 

n=l 


li 
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and 


°o 

E p-£(x„2/(|jr„|  < K))  < oo.  (2.4) 

n=l  °n 

The  following  example  shows  that  the  SLLN  (2.2)  can  hold  even  though  (2.1) 

fails. 

Example  2.1.1.  Let  {Xn,  n > 1}  be  a sequence  of  independent  random  vari- 
ables and  {«„,  n > 1}  be  a sequence  of  constants  with  1 < an  t oo,  ^ ~ °°? 

and 


Let  bn  = 2",  n > 1,  and  note  that  (2.4)  does  not  hold  since 


OO  ^ OO  - 

E l*»l  < *«))  = E |X„|  < 2")) 


, K 

n—l  n 


n=  1 


“ 2-^  22”  V a2 

n- 1 v « 
oo 

= E^ 


1 an 
n=l  ” 


= 00. 


(2.5) 


Hence  Proposition  2.1.1  cannot  be  applied.  However,  using  only  first  principles,  we 
have  for  all  n > 2,  with  probability  1 


T 


E (*<  - E(XiI(\X,\  < 2'))) 
«=1 


<?Ew 
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< 


< 


2.V  — 

9 " 2^  a. 
z .=i  “• 

^ V — — V — 

r ^ ai  + r ^ ^ 

i=l  * i=[n/2]+l 

1 [n/2]  n 

iy2'  + — 1 — y 
•>"  2 "<*K2)+1  A 


i=l 


i=[n/2] 


2(n/2)+l  2n+! 

2n  On^, 

2 <*[n/2]+l 


2 2 

2"/2  + «[n/2]+l 

->  0. 


Thus  the  SLLN 


|r  £ (X‘  “ £WI^I  < 2<)))  ->  0 a.c.  (2.6) 

obtains. 

Even  though  (2.6)  was  derived  using  only  first  principles,  it  illustrates  some 
limitations  of  Proposition  2.1.1.  This  suggests  the  need  to  investigate  the  conditions 
of  the  proposition  in  order  to  understand  the  above  limitations.  Three  questions  that 
arise  are  the  following: 

• Can  (2.4)  be  weakened  to  yield  the  conclusion  (2.2)? 

• Do  any  new  conditions  need  to  be  added  to  a weaker  version  of  (2.4)? 

• Under  what  condition  can  the  truncated  expectation  in  (2.2)  be  replaced  by  the 
actual  expectation  of  (assuming  the  Xi  are  in  £i)? 
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In  this  chapter  these  questions  will  be  answered  in  the  more  general  context  of  the 
case  of  a sequence  of  independent  random  elements.  The  conclusion  of  Example  2.1.1 
will  be  shown  to  follow  immediately  from  a more  general  form  of  Proposition  2.1.1 
which  will  be  obtained  in  Section  2.3.  See  Theorem  2.3.1,  Examples  2.1.1  and  2.4.1, 
and  Remarks  3.3.2  and  3.3.3.  Theorem  2.3.1  thus  extends  Proposition  2.1.1  in  two 
directions,  namely: 

• Theorem  2.3.1  pertains  to  a sequence  of  independent  Banach  space  valued  ran- 
dom elements  rather  than  to  a sequence  of  independent  random  variables  as 
does  Proposition  2.1.1. 

• Theorem  2.3.1,  when  specialized  to  the  random  variable  case,  pertains  to  a 
wider  class  of  sequences  of  random  variables  than  does  Proposition  2.1.1. 

However,  before  we  proceed  with  establishing  Theorem  2.3.1,  we  provide  in  the  follow- 
ing section  necessary  conditions  for  a SLLN  with  independent  Banach  space  valued 
random  element  summands. 

2.2  Necessary  Conditions  for  a SLLN 

The  first  theorem,  Theorem  2.2.1,  provides  necessary  conditions  for  in- 
dependent Banach  space  valued  random  elements  to  obey  a SLLN.  The  random 
elements  {14?  n > 1}  are  assumed  to  be  symmetric ; that  is,  Vn  and  —Vn  are 
identically  distributed  for  all  n > 1.  Of  course  it  is  assumed  that  not  all  of  the 
{Vn,  n > 1}  are  degenerate.  (A  random  element  V is  said  to  be  degenerate  if  for 
every  B £ B,P{V  € B}  E {0,1}.)  Thus  it  is  assumed  for  some  n > 1 and  some 
Bn  € B that  P{Vn  € Bn}  > 0 and  P{Vn  € Bcn}  > 0. 

Conclusions  (2.8)  and  (2.9)  of  Theorem  2.2.1  were,  in  effect,  proved  by  Mar- 
tikainen  (1979)  in  the  random  variable  case.  The  argument  presented  below  for  (2.9) 
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is  entirely  different  and  more  straightforward  than  that  of  Martikainen  (1979).  (See 
Kesten  (1972)  and  Rosalsky  and  Teicher  (1981)  for  some  related  results  concerning 
law  of  the  iterated  logarithm  type  behavior  for  the  random  variable  case.) 

The  following  technical  lemma  is  used  in  the  proof  of  (2.8)  of  Theorem  2.2.1.  For 
a random  element  V,  let  a(V)  denote  the  tr-algebra  generated  by  V. 

Lemma  2.2.1.  The  sum  of  two  independent  random  elements  in  a real  separable 
Banach  space  X (at  least  one  of  which  is  nondegenerate)  is  nondegenerate. 

Proof.  Let  V\  and  V2  be  independent  random  elements  where  V\  is  nondegen- 
erate and  suppose  that  V\  + V2  ==  v a.c.  for  some  v G X.  Then  V2  is  nondegenerate. 
Since  V\  is  independent  of  V2  and  since  V\  = v — V2  a.c.,  we  have  a[y  — V2)  is  indepen- 
dent of  o-(V2).  But  <y{y  — V2)  = cr{V2)  and  hence  a(V2)  is  independent  of  itself.  Then 
for  every  A € (r(V2),  P{A}  = P{AA]  — P{A}  ■ P{A}  = (P{A})2  implying  P{A } is 
either  0 or  1.  This  contradicts  the  fact  that  V2  is  nondegenerate.  □ 

Theorem  2.2.1.  Let  Sn  = 1 where  { Vn , n > 1}  is  a sequence 

of  independent  symmetric  random  elements  (not  all  degenerate)  in  a real  separable 
Banach  space.  If 


&n  n 

i 0 a.c. 

0„ 

for  some  sequence  of  positive  constants  {bn,  n > 1},  then 

bn  — > 00, 


<Sn 

bl 


0 a.c. 


(2.7) 


(2.8) 


(2.9) 
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where  0 < b*n  = inf,>„  bj  t oo,  and 

OO 

YdP{\\Vn\\>ebn}  < 00  for  all  e > 0.  (2.10) 

n= 1 

Remark  2.2.1.  (i)  Theorem  2.2.1  establishes  that  condition  (2.7)  and  the  ap- 
parently stronger  (in  view  of  6*  < ?>„,  n > 1)  assertion  (2.9)  are  indeed  equivalent, 
(ii)  It  should  be  noted  that  the  symmetry  hypothesis  will  not  be  used  in  the  proof  of 
(2.8). 

Proof  of  Theorem  2.2.1.  To  prove  (2.8),  assume  that  it  fails.  Then  there 
exist  a constant  0 < M < oo  and  a subsequence  n{k)  t oo  such  that  &„(<,)  < M,  k > 1. 
Then  for  arbitrary  e > 0 


efll&mll  > £ i.o.(fc)}  < P{  !!^!1  > ~ i.o.(fc) 


* P{^T  - 5 L°-(n) 


= 0 


(by  (2.7)). 


Thus 


Sn(k)  t 0 a.c. 


(2.11) 


Choose  k0  so  that  at  least  one  V*  (1  < i < n(k0 ))  is  nondegenerate.  Now  (2.11)  can 
be  rewritten  as 


n(fc0)  n(k) 

EVi  + lim  Vi  — 0 a.c. 

it  -»no  ■£— < 


i=l 


i=n(k0)+l 


(2.12) 
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By  Lemma  2.2.1,  X^=io)  K is  nondegenerate.  Then  by  the  independence  of  K 

and  lim^oo  Yl’i=n{k0)+i  we  ^ave  by  again  applying  Lemma  2.2.1  that  their  sum 
must  be  nondegenerate  which  contradicts  (2.12).  Thus  (2.8)  holds. 

Assertion  (2.9)  will  now  be  proved.  It  is  clear  that  b*n  f oo  in  view  of  (2.8).  Now 
for  each  n > 1,  b*n  = bj(n)  for  some  j(n)  > n.  Note  at  the  outset  that  (2.7)  ensures 

jp 

that  Sn/bn  — » 0 which,  in  turn,  ensures  that 

A 0.  (2.13) 

Now  for  arbitrary  £ > 0 and  all  large  n and  all  k > n we  have  (interpreting  Yli=k+i 
as  0) 


= i-e{lis,w-st||>|6iw} 

> i - (p{ll5imll  > + e{||S*||  > 

> 1 - (p{||S,w||  > } + p{  | 116,-H  > -f'jifc,)) 

> 1 - (e{||%)||  > jtiw}  + 2p{||S,(»)||  > 


(by  the  random  element  version  of  Levy’s  inequality  (see,  e.g., 
Araujo  and  Gine  (1980,  p.  102))) 


= 1—  3P{||SJ,„||  > 


>i 

“ 2 


(by  (2.13)). 


(2.14) 
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and  the  class  of  events 


Now  for  all  k > n > 1,  the  event  ||j  )T  (=*-'+ 1 K|j  < §5j{k) 

{[l|S|l  > ,.)]  : r = n,  • • • , fcj  are  independent.  Thus  by  the  Lemma  for  Events 

(see,  e.g.,  Loeve  (1977,  p.  258)),  for  all  large  n 


P<  [J  [||S4||  > ebm 

k=n 


i(*) 

..  £ * 
i — k- f-1 


< 2 bm 


> p< 


oo 

U [II 

k=n 


5*11  > eft 


'm 


inf  P< 

k>n 


m 

£ v‘ 

i=k+ 1 


< lb; 


'j(k) 


k=n 


> eb 


m 


(by  (2.14)). 


(2.15) 


Hence 


IIS.II 


> 


e i.o.(n)  1 = lim  P | U [ns‘ii  > ebj( jfcjj 
J l k=n 


<2„liS.pi  U [lls‘H  > ebm 

k—n  u i=k+ 1 


i(fc) 


£« 


£ 

S 2bm 


(by  (2.15)) 


I OO 

U [lISwII  > f 


k=n 


= 2 Pi  | i.o.(rc) 

bj(n)  2 


<2P<\m>il0.(n) 


= o 


(by  (2.7)). 


Thus  (2.9)  holds. 
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To  prove  (2.10),  it  follows  from  bn  > b*n  t oo  and  (2.9)  that  for  all  n > 2, 


k ~ b*n 

\\Sn-Sn-iW 

K 

^WSnW  l^n-lll 

- K b*n 

„ ll^nll  ^ ||5U|| 


— » 0 a.c. 


Thus  for  arbitrary  e > 0 


> e i.o.(n) 


= 0 


whence  (2.10)  follows  from  independence  and  the  Borel-Cantelli  lemma.  □ 

The  following  example  shows  that  Theorem  2.2.1  can  fail  without  the  indepen- 
dence assumption. 


Example  2.2.1.  Let  V be  a symmetric  random  element  with  E||V||“  = oo  for 
some  a € (|,  1).  Define  the  sequence  of  symmetric  random  elements  {Vn,  n > 1}  by 


Vi  = -v,  V„  = V n > 2. 

nyn  — 1) 

The  {V^,  n > 1}  are  of  course  not  independent.  Then  for  n>  2, 

t=l 
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Let  bn  — \ , n > 1.  Then  for  n > 2, 

nz  or 

5„  -V/n  -V 
T = 771- i = "TZT  0 ax- 

1 /n  o,  na 

since  0 < a < 1.  But  bn  -»  0 since  a > i and  so  £>„  -4  oo  fails.  Note  that 

&*  = inf  &.•  = 0,  n > 1 

j>n 

and  thus  the  expression  Sn/b*n  in  (2.9)  is  not  defined.  Finally,  note  that  for  all  e > 0 


en(n  — 1) ) 
n « ) 


OO 

>X>{ni 

n=2 


> £n1/a} 


= oo  (since  £'||Vr||"  = oo) 


whence  (2.10)  fails. 
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2.3  Sufficient  Conditions  for  a SLLN 


2.3.1  SLLNs  for  Sums  of  Independent  Random  Elements  in  Rademacher 
Type  p Banach  Spaces 

The  following  proposition  will  be  utilized  in  establishing  Theorem  2.3.1. 

Proposition  2.3.1.  (Adler,  Rosalsky,  Taylor  (1992a))  Let  {Vn,  n > 1}  be 
a sequence  of  independent  random  elements  in  a real  separable,  Rademacher  type 
P (1  < P < 2)  Banach  space  and  let  { bn , n > 1}  be  a sequence  of  positive  constants 
with  bn  f oo.  If 


discussed  later  in  more  detail,  this  result  is  new  even  when  {Vn,  n > 1}  is  a sequence 
of  independent  random  variables. 

Theorem  2.3.1.  Let  {Vn,  n > 1}  be  a sequence  of  independent  random  elements 
in  a real  separable  Rademacher  type  p (1  < p < 2)  Banach  space  X,  and  let  {an,  n > 


then  the  SLLN 


obtains. 


The  main  result  of  this  chapter  may  now  be  stated  and  proved.  As  will  be 


1}  and  { bn , n > 1}  be  sequences  of  positive  constants  with  bn  | oo  such  that  either 


(2.16) 
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or 


£a,=0(&„)  (2.17) 

£=1 

hold.  Suppose  that  for  some  A > 0 and  for  all  e > 0 

OO 

£^{11^,11  > Xbn}  <00  (2.18) 

n=l 

and 

OO  J 

£ WE\\VnI{ean  < ||Vn||  < A bn)  - E(VnI(ean  < \\Vn\\  < A6n))||p  < oo.  (2.19) 

n=l  ” 

Then  the  SLLN 

1 ” 

£ (Vi  - E(ViI( IIKII  < A6,-)))  ->  o a.c.  (2.20) 

°n  i= i 7 

obtains. 

Remark  2.3.1.  If  p = 1,  then  (2.16)  implies  (2.17)  by  the  Kronecker  lemma. 
But  in  general  the  conditions  (2.16)  and  (2.17)  are  independent  of  each  other  in  the 
sense  that  neither  implies  the  other  as  will  now  be  shown  via  examples. 

(i)  An  example  of  sequences  {an,  n > 1}  and  {&„,  n > 1}  satisfying  (2.16)  but 
not  (2.17)  is  given  as  follows:  Suppose  1 < p < 2 and  p-1  < a < 1.  Let  an  = 1 and 
bn  = n“,  n > 1. 

(ii)  An  example  of  sequences  {a„,  n > 1}  and  {&„,  n > 1}  satisfying  (2.17) 
but  not  (2.16)  is  given  as  follows:  Suppose  p — 2.  Let  an  = 2n  and  bn  = ^"=1  2*  = 
2n+1  - 2,  n > 1. 
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(iii)  Of  course  if  1 < p < 2 and  an  = 1 and  bn  = n,  n > 1,  then  both  (2.16)  and 
(2.17)  hold. 

Proof  of  Theorem  2.3.1.  Let  e > 0 be  arbitrary  and  define 

vll)  = ViI(\\V,\\<eai),  i>l, 

V;(2)=V'/(£aj<||V'i||<A6i),  i > 1, 

and 


Vf*  = Vi/flIK-ll  > Xb,),  <>1. 


Writing 

Vi  - £(v;/(||v;||  < a hi))  = (v;(1)  - EV^)  + (vf  > - EV?])  + v;(3),  • > 1 


yields 


°n  i=  1 7 

=f  t (^  - **?')  +l±  (if  > - EV*)  +l±  if  \ nil.  (2.21) 

" «=1  °n  i=  1 ^ ,-l 


Zn  — 


P„(2)  - EVJi2) 


n > 1. 


Let 
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Now 

OO 

E£HZ"H' 

n=l 
oo  - 

= Y,WE  ||K/(fan  < IIKH  < A6„)  - E(ynI(£an  < ||VB||  < Xbn))\\p 
< oo  (by  (2.19)). 


Thus  by  Proposition  2.3.1 


r-£(yi” -&!»)->  o 

°n  i=i  ' 


a.c. 


Next,  note  that  by  (2.18) 


OO  OO 

Ep{kP  > ^ o}  = E e{||V„l|  > A6„}  < oo 

n= 1 n=l 


and  thus  {Vn3\  n > 1}  is  Khintchine  equivalent  to  0 yielding 


1 " 


(3) 


0 a.c. 


i=i 


since  bn  f oo. 

Now  under  (2.16), 


IP  oo 


yg||K,wr 

w - if 


n=l 


n=l  ^ 


(2.22) 


(2.23) 


< oo 
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whence  by  Proposition  2.3.1  we  have 


n i=l 


(2.24) 


Combining  (2.22),  (2.23),  and  (2.24)  as  in  (2.21)  establishes  (2.20). 
Finally,  under  (2.17),  a constant  0 < C < oo  can  be  chosen  so  that 

n 

^ a;  < Cbn,  n > 1. 


(2.25) 


Since 


P(1)  - EV{1) 


< 2 ea;,  i > 1,  we  have  for  all  n > 1,  with  probability  one, 


Y.{v,m-EV?)  <l£||  V"-EV? 

*=1  i— 1 


Thus 


5 rE“' 


«=1 


< 2 eC  (by  (2.25)). 


lim  sup  — 

n— >oo  0n 


n 

E( 

i— 1 


K-(1)  - £v;.(1)) 


< 2 eC  a.c. 


(2.26) 


Combining  (2.22),  (2.23),  and  (2.26)  as  in  (2.21)  gives 


lim  sup 

n— >oo  0n 


£(K-£(V(|M||<AI,))) 

i=  1 


< 2 eC  a.c. 


thereby  establishing  (2.20)  since  e > 0 is  arbitrary.  □ 


Remark  2.3.2.  Observe  that  (2.16)  is  weaker  for  larger  p. 
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Remark  2.3.3.  Assertion  (2.22)  can  also  be  obtained  by  using  Theorem  V.7.5 
(or  Corollary  V.7.5)  of  Woyczyriski  (1978)  and  the  Kronecker  lemma  instead  of  ap- 
plying Proposition  2.3.1. 

Remark  2.3.4.  It  should  be  noted  that  the  assumption  of  independence  was 
utilized  in  the  proof  of  Theorem  2.3.1  only  to  obtain  the  convergence  of  the  middle 
truncation  (i.e.,  to  prove  that  £ £)”=1  (V)(2)  - EV^)  -4  0 a.c.)  and  to  establish 
(2.24)  under  (2.16).  In  Theorem  2.3.4  we  will  obtain  aversion  of  Theorem  2.3.1  (with 
p—  1)  without  the  independence  assumption. 

Remark  2.3.5.  It  will  now  be  shown  that  (2.19)  holds  if 

oo 

Y ¥E(\\V„\\n(ean  < ||Vn||  < \b„))  < oo.  (2.27) 

n=l  n 

Proof.  Note  that  for  all  n > 1, 

E\\V„I(ea„  < ||V„||  < A b„)  - E(VJ(sa„  < ||V„||  < A6„))||p 

< 2p(^(||Vr„||p/(£on  < ||l„||  < A b„))  + \\E(VJ(ea„  < ||V„||  < A4„»||'>) 

< 2p^E(\\Vn\\pI(ea„  < ||V„||  < Xb„))  + £(||V'„||''/(ea„  < ||V„||  < AM)) 

= 2p+IE(\\Vn\\pI(ean  < ||V„||  < A *„)). 


1 

Y ^E\\V„I(ea„  < IIKII  < Ai„)  - E(VJ(ea„  < ||Vn||  < AM)||' 

n=  1 n 

oo 

< 2p+i  y < iiK*ii  < am) 

17=1 


Thus 
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<oo.  □ 


We  now  give  an  example  where  (2.19)  holds  but  (2.27)  fails. 

Example  2.3.1.  Let  {Xn,  n > 1}  be  a sequence  of  independent  random  vari- 
ables with 


P{Xn  = n}  = H 2 1 = 1 - P{Xn  = 0},  n > 1. 
n 


Let  an  = 1 and  6n  = n,  n > 1.  Setting  p = 2 and  A = 1 we  have 


^ 1 w -1/  2 i \ °°2i 

^^£(A"7(£<  ,Anl  - = 

n= 1 n= 1 x x Ti—l 

and  thus  (2.27)  fails.  However,  (2.19)  holds  since  for  0 < E < 1 

°°  1 2 

E < l*n|  <n)~  E{XnI(e  < \Xn\  < n))) 

11=1 

o°  i r 

= E ^ E(xnl(£  < \Xn\  < n))  - [E(XnI(e  < \Xn\  < n)))‘ 

71=1 


oo 


= E 


n2  - 1 


n=l 


n 


< 00. 


The  next  result  is  a version  of  Theorem  2.3.1  where  the  truncated  expectations 
are  replaced  by  true  expectations.  Of  course,  in  contrast  to  Theorem  2.3.1,  it  must 
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be  assumed  in  Theorem  2.3.2  that  the  underlying  sequence  of  random  elements  have 
expected  values. 

Theorem  2.3.2.  Let  {Tn,  n > 1}  be  a sequence  of  independent  random  elements 
in  a real  separable  Rademacher  type  p (1  < p < 2)  Banach  space  and  suppose  the 
{Vn,  n > 1}  all  have  expected  values.  Let  {a„,  n > 1}  and  {bn,  n > 1}  be  sequences 
of  positive  constants  with  bnfoo  such  that  either 


(2.28) 


or 


n 


(2.29) 


hold.  Suppose  that  for  some  A > 0 and  for  all  e > 0 


OO 


(2.30) 


(2.31) 


and 
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Then  the  SLLN 


1 

— {Vi  - EVi ) -»  0 a.c. 

On  . . 


(2.33) 


obtains. 


Proof.  By  Theorem  2.3.1,  the  conditions  (2.28)  (or  (2.29)),  (2.30),  and  (2.32) 
ensure  that  the  SLLN 


obtains.  Combining  this  with  the  condition  (2.31)  yields  (2.33)  thereby  proving  the 
result.  □ 

The  following  is  a generalization  of  Proposition  2.1.1  to  the  random  element  case 
with  general  1 < p < 2. 

Corollary  2.3.1.  Let  {Vn,  n > 1}  be  a sequence  of  independent  random  el- 
ements in  a real  separable  Rademacher  type  p (1  < p < 2)  Banach  space  X.  If 
{bn,  n > 1}  is  a sequence  of  positive  constants  with  bn  ^ oo  and 


(2.34) 


then  the  SLLN 


(2.35) 


obtains. 
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Proof.  By  an  argument  similar  to  that  of  Heyde  (1968),  the  condition  (2.34)  is 
equivalent  to  the  pair  of  conditions 

OO 

]TP{||K||  >bn}  <oo  (2.36) 

n— 1 

and 

OO 

E 7p£(l|K||’7(||V„||  < b„))  < oo.  (2.37) 

n=l  " n 

Now  (2.37)  certainly  ensures  that 

oo 

E < iik.ii  < m)  < oo  <2.38) 

for  all  e > 0 and  for  any  choice  of  {an,  n > 1}.  Choose  in  particular  {an,  n > 1} 
to  satisfy  either  (2.16)  or  (2.17).  The  conclusion  (2.35)  then  follows  from  (2.36)  and 
(2.38)  by  Theorem  2.3.1.  □ 

Remark  2.3.6.  In  Corollary  2.3.1,  there  is  a trade-off  between  the  Rademacher 
type  and  the  condition  (2.34);  the  larger  p,  the  stronger  is  the  condition  on  the 
underlying  Banach  space  X but  the  weaker  is  the  condition  (2.34).  To  see  that  (2.34) 
is  weaker  for  larger  p,  since  (2.34)  is  equivalent  to  the  pair  of  conditions  (2.36)  and 
(2.37)  as  was  noted  in  the  proof  of  Corollary  2.3.1,  it  suffices  to  show  that  (2.37)  is 
weaker  for  larger  p.  Let  1 < Po  < p < 2 and  suppose  that  po  satisfies  (2.37).  Then 

oo 

E^£(iiKir/(rn||<6„)) 

n=l  n 

(uv;iiw  ” '(iwi  ^ 
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oo 

sE«7£(lly»llTC/(llv'-H£M) 

n=  1 n 
< OO 


and  so  p satisfies  (2.37). 

The  following  corollary  is  a version  of  Corollary  2.3.1  where  the  truncated  expec- 
tations are  replaced  by  true  expectations.  Of  course,  in  contrast  to  Corollary  2.3.1, 
it  must  be  assumed  that  the  underlying  sequence  of  random  elements  have  expected 
values. 


Corollary  2.3.2.  Let  {Vn,  n > 1}  be  a sequence  of  independent  random  ele- 
ments in  a real  separable  Rademacher  type  p (1  < p < 2)  Banach  space  and  suppose 
the  {Vn,  n > 1}  all  have  expected  values.  If  {bn,  n > 1}  is  a sequence  of  positive 
constants  with  bn  f oo, 


EE 


n— 1 


( \mv  \ 

ViiK.ir+i«) 


< oo, 


and 


f£i?(vU(||v;||>6<))->o 

°n  i=  1 


(2.39) 


then  the  SLLN 


rlt,(Vi~  E(Vi))  -*  0 a.c. 

n «=i 

obtains. 

Proof.  The  result  follows  immediately  from  (2.35)  and  (2.39).  □ 
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The  following  lemma  will  be  used  in  the  proof  of  Corollary  2.3.3  and  in  Example 
2.4.6. 

Lemma  2.3.1.  (Adler  and  Rosalsky  (1987))  Let  {Yn,  n > 1}  be  a sequence  of 
random  variables  which  is  stochastically  dominated  by  a random  variable  Y in  the 
sense  that  for  some  constant  0 < D < oo 

P{\Yn\  >t}<  DP{\DY\  > t},t  > 0,  n > 1. 

Let  { bn , n > 1}  be  a sequence  of  positive  constants  such  that 


\ 00  i 

max  dE  = 0(n)  for  some  p > 0 

/ ■>’— n * 


and 


]T>{|y|  > Dbn]  < oo. 

n=l 

Then  for  all  0 < M < oo, 

°o  1 

J2^E(\Yn\"I(\Y„\<MK))  <oo. 

n=l 

The  following  corollary,  due  to  Adler,  Rosalsky,  and  Taylor  (1989),  is  a ran- 
dom element  version  of  a famous  and  classical  result  of  Feller  (1946).  In  the  spe- 
cial case  where  £7||V"i||r  < oo  for  some  r € [l,p)  and  bn  = n1/r,  n > 1,  Corollary 
2.3.3  reduces  to  the  Marcinkiewicz-Zygmund  type  SLLN  (X)”=1  Vi)/nl^r  -*  0 a.c.  of 
Woyczyriski  (1980).  Lai  (1974)  showed,  via  example,  that  in  general  for  a real  sep- 
arable Banach  space,  the  Marcinkiewicz-Zygmund  SLLN  cannot  be  extended  to  the 
case  of  i.i.d.  mean  0 random  elements  {Cn,  n > 1}  satisfying  E'||Vri||r  < oo  for  some 
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1 < r < 2.  Lai’s  example  is  for  the  Banach  space  of  real  sequences  b = {bj,  j > 1}  con- 
verging to  0 with  norm  \ \b\  \ = maxy>i  |6j|  and  this  Banach  space  is  only  of  Rademacher 
type  1.  Thus,  the  additional  condition  in  Corollary  2.3.3  that  X is  of  Rademacher 
type  p where  1 < p < 2 is  not  superfluous. 

Corollary  2.3.3.  (Adler,  Rosalsky,  and  Taylor  (1989))  Let  {Pn,  n > 1}  be 
a sequence  of  i.i.d.  mean  0 random  elements  in  a real  separable,  Rademacher  type 
p (1  < p < 2)  Banach  space  X and  let  {bn,  n > 1}  be  a sequence  of  positive  constants 
such  that 


If 


— 4-  and  — t for  some  a > 
n na  p 


^^{ll^ill  > M < °o,  (2.40) 

n— 1 


then 


EIU  Vi 


0 a.c. 


(2.41) 


Proof.  Let  {an,  n > 1}  be  a sequence  of  positive  constants  satisfying  (2.16)  or 
(2.17).  Now  f and  hence  bn  f oo.  As  in  the  proof  of  Theorem  4 of  Adler,  Rosalsky, 
and  Taylor  (1989) 

°o 

i~n  ® 


Then  by  (2.40)  and  Lemma  2.3.1  with  Yn  = ||K,||,  n > 1 and  Y = ||Vj||  we  have 
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0° 

E ¥ mum™*  < iikii  < bn))  < y,  j7B(iiv'„ip/(iiK,n  < b„))  < oo. 

1 ^71  , 


Hence  by  Remark  2.3.5  and  Theorem  2.3.1, 


rY(v<-  < *i>>) 

n »=i 


rE(v‘-E(^(iNi<M)) 

Un  i= i ' 


— * 0 a.c. 


Thus  to  achieve  the  conclusion  (2.41),  it  only  remains  to  show  that 

fE£(v'i/(IM|<6i))->o. 

Vn  ■ , 
i=l 

To  this  end,  since  EVi  = 0,  * > 1,  we  have  for  n > 1 


K 


E^y./niv.iisM) 

i=i 


EB(Miiviii>w) 

i=  1 


^rE^IWWIWI  >*<<)) 

°n  i=  1 

— > 0 (see  Chow  and  Teicher  (1978,  pp.  123-124)) 


and  hence  the  result  is  obtained.  □ 

The  next  two  corollaries  are  special  cases  of  Theorems  2.3.1  and  2.3.2,  respec- 
tively with  an  = bn  — £>„_!,  n > 1. 
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Corollary  2.3.4.  Let  {14,  n > 1}  be  a sequence  of  independent  random  ele- 
ments in  a real  separable  Rademacher  type  p (1  < p < 2)  Banach  space  X and  let 
{bn,  n >1}  be  a sequence  of  positive  constants  with  bn  f oo  and  set  b0  = 0.  Suppose 
that  for  some  A > 0,  some  1 < p < 2 and  all  e > 0 

OO 

X]p{llv"ll  > AM  < °0,  (2.42) 

n=l 

and 

oo  1 

E Tj;E\\VJ(e(K  - bn- 1)  < HKH  < A K) 

n=  1 n 

- E(VnI{e{bn  - bn-x)  < \\Vn\\  < A5n))||p  < oo.  (2.43) 

Then  the  SLLN 

fti(V‘-E(yA MK||<A6„)))  ^0a.c. 

0n  i=l  7 

obtains. 

Proof.  Setting  an  = bn  - 6„_l5  n > 1 yields 


1 _ bn  _ 

h a'  h ~ 1 


0(1). 


(2.44) 


«=i 


The  result  follows  from  (2.42),  (2.43),  and  (2.44)  by  Theorem  2.3.1.  □ 

Corollary  2.3.5.  Let  {14,  n > 1}  be  independent  C\  random  elements  in  a real 
separable  Rademacher  type  p (1  < p < 2)  Banach  space  X and  let  { bn , n > 1}  be 
a sequence  of  positive  constants  with  bn  | oo  and  set  b0  = 0.  Suppose  that  for  some 
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A > 0,  some  1 < p < 2 and  all  e > 0 

OO 

£P{||VB||>A6B}<oc,  (2.45) 

n— 1 


££(k/(||K||>A6,.))  =<,((.„),  (2.46) 

t=l 


and 


1 

£ j3r£||K,/(s(»„  - < UK. II  < A6„) 

n=l 

- E(ynI(e(b„  - V-0  < UK ||  < A6n))  ||p  < oo.  (2.47) 

Then  the  SLLN 

1 n 

r-  (K  - PK)  ->  0 a.c. 
bn  i=  i 

obtains. 

Proof.  Setting  a„  = 6n  - n > 1 yields 

f£ai=r  = 1=0(1)-  (2-48) 

un  i—  1 Un 

The  result  follows  from  (2.45),  (2.46),  (2.47)  and  (2.48)  by  Theorem  2.3.2.  □ 

2.3.2  SLLNs  for  Compactly  Uniformly  Integrable  Sequences  of  Indepen- 
dent Random  Elements 

In  the  next  theorem,  a version  of  Theorem  2.3.2  is  obtained  by  replacing  the 
hypothesis  that  X is  of  Rademacher  type  p by  the  hypothesis  that  {Un,  « > 1}  is 
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compactly  uniformly  integrable  and  by  replacing  the  condition  (2.32)  by  the  condition 
(2.52). 


Theorem  2.3.3.  Let{Vn , n > 1}  be  a sequence  of  independent  random  elements 
in  a real  separable  Banach  space  X , let  1 < p < 2,  and  let  {an,  n > 1}  and  {bn,  n > 
1}  be  sequences  of  positive  constants  with  bn  | and  n — 0(bn)  such  that  either 


(2.49) 


or 

n 

Y <*«  = 0(bn)  (2.50) 

«=i 


hold.  Suppose  that  for  some  A > 0 and  for  all  e > 0 


^F{||y„||  > A6n}  <oo  (2.51) 

n—  1 


and 


E ^E|IIKI|/(«„  < ||V.||  < \b„)  - B(||V.||/(eo„  < HV.H  < A6„))|p  < oo.  (2.52) 

n- 1 n 


Then  if 


{Vn,  n > 1}  is  compactly  uniformly  integrable, 


(2.53) 


1 

7~Y(Vi-  EVi)  ->  0 a.c. 


the  SLLN 
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obtains. 

Proof.  Let  C be  such  that  n < Cbn,  n > 1.  Clearly  bn  t oo.  In  view  of  the 
work  of  Cuesta  and  Matran  (1988),  Section  4,  it  suffices  to  verify  that 

4£(ri||-£!||v;||)-t0a.c.  (2-54) 

j=l 

and  that 

T E GW)  - e9(V,))  ->  0 a.c.  (2.55) 

for  every  bounded  and  continuous  real  function  g on  X . To  prove  (2.54),  note  that 
since  R is  of  Rademacher  type  p for  every  p £ [1,2],  we  can  apply  Theorem  2.3.1  to 
the  sequence  of  random  variables  {||Vn||,  n > 1}  thereby  yielding 

£ E (iMI  - ^(IMWIMI  < A*.)))  -*  0 a.c.  (2.56) 

It  will  now  be  shown  that 

£(IIK||/(||V;||>  A6„))  ->0.  (2.57) 

Let  £ > 0 be  arbitrary.  By  (2.53),  there  exists  a compact  subset  Ke  of  X such  that 

SnpE\\VJ(Vn^Ks)\\<£. 
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Since  Ke  is  compact,  it  is  bounded  (see,  e.g.,  Dugundji  (1966)  p.  233)  and  so  there 
exists  a constant  M < oo  such  that 

Ke  C {d  g X : ||v||  < M}. 

Thus,  whenever  n is  such  that  A bn  > M, 

[\\Vn\\  > A bn\  C [Vn  i K']. 


Then  since  bn  t oo,  for  all  large  n 


£(I!K,||/(||K||  > Af>„))  < £(||n||/(K  t K,))  < e 

thereby  establishing  (2.57)  since  e > 0 is  arbitrary.  But  then 

A E > Xb‘D  < ^£(11^11/(11^11  > \bj))  -y  0 (2.58) 

On  71 

n i= 1 i=  1 

by  (2.57)  and  the  Cesaro  mean  summability  theorem.  Combining  (2.56)  and  (2.58) 
yields  (2.54). 

Next,  to  verify  (2.55),  let  g be  a bounded  and  continuous  real  function  defined 
on  X.  Then,  letting  B — sup  { |g(v)|  : v E X}, 


Vas(g{Vn))  E(g(Vn))  nZnt'ST'  1 

<z^  p B 2^~ 2 <0° 


n=l  n 


n= 1 " 


n—  1 


and  hence  by  the  Khintchine-Kolmogorov  convergence  theorem 


^ S(K)  - E(g(V„)) 

> - converges  a.c. 


n= 1 


bn 
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and  (2.55)  follows  immediately  by  the  Ivronecker  lemma.  □ 

Remark  2.3.7.  In  the  spirit  of  Remark  2.3.5,  the  condition  (2.52)  will  hold  if 


^ 1 

Y ¥E( ||V„||>7(ea„  < ||V„||  < Xb„))  < oo.  (2.59) 

The  following  is  a version  of  Corollary  2.3.1  where  the  hypothesis  that  X is  of 
Rademacher  type  p is  replaced  by  the  hypothesis  that  {K,,  n > 1}  is  compactly 
uniformly  integrable.  In  view  of  Remark  2.3.6  the  result  is  presented  for  p = 2 in 
condition  (2.60). 

Corollary  2.3.6.  Let  { Vn , n >1}  be  a compactly  uniformly  integrable  sequence 
of  independent  random  elements  in  a real  separable  Banach  space.  If  {bn,  n > 1}  is 
a sequence  of  positive  constants  with  bnf,n  = 0(bn),  and 


T,E 


n= 1 


< 00, 


(2.60) 


then  the  SLLN 


±'j>2{Vi-EVi)->0a.c. 
■ 1 


(2.61) 


obtains. 


Proof.  By  the  argument  of  Heyde  (1968),  the  condition  (2.60)  is  equivalent  to 
the  pair  of  conditions 

OO 

£p{r„ii>6„}<oo 

n— 1 


(2.62) 
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and 


1 

£?£(||V„||2/(||K,M<  !»„))<  oo. 


(2.63) 


Let  p — 2 and  A = 1.  Now  (2.63)  certainly  ensures  that  (2.59)  holds  for  all  e > 0 
and  for  any  choice  of  {a„,  n > 1}.  Choose  in  particular  {an,  n > 1}  to  satisfy 
either  (2.49)  or  (2.50).  The  conclusion  (2.61)  then  follows  from  (2.62)  and  (2.59)  by 
Theorem  2.3.3  and  Remark  2.3.7.  □ 

The  last  two  corollaries  follow  from  Theorem  2.3.3.  The  first  one  is  due  to  Adler, 
Rosalsky,  and  Taylor  (1992a),  and  the  second  one  to  Taylor  and  Wei  (1979). 

Corollary  2.3.7.  (Adler,  Rosalsky,  Taylor  (1992a))  Let  {Vn,  n > 1}  be  a se- 
quence of  independent  random  elements  in  a real  separable  Banach  space  and  let 
{&„,  n > 1}  be  a sequence  of  positive  constants  with  bn  t and  n — 0(bn).  If 


{K,  n >1}  is  compactly  uniformly  integrable 


(2.64) 


and 


(2.65) 


then  the  SLLN 


(2.66) 


obtains. 
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Proof.  Let  an  = 1,  n > 1 and  let  A = 1.  Note  that  (2.50)  holds  by  the 
assumption  n = 0(bn).  Moreover, 

oo  oo 

£p{IIK,||>A6„}=Ep{||K,II>M 

n=l  n= 1 

^ E\\Vn\\p  , 

— /-*>  — ap (by  the  Markov  inequality) 

n=l 

< oo  (by  (2.65)). 

Thus  (2.51)  holds.  Next,  note  that 

E j?E( IIK>l|V(™n  < IIK.H  < A6„))  < V -£||K||'  < 00  (by  (2.65)) 

n=l  " n= 1 

and  hence  (2.52)  holds  by  Remark  2.3.7.  Thus  by  Theorem  2.3.3  the  conclusion  (2.66) 
obtains.  □ 

The  following  lemma  will  be  used  in  the  proof  of  Corollary  2.3.8. 

Lemma  2.3.2.  If  {Vn,  n > 1}  w a sequence  of  random  elements  with 


then 


sup  £’||Vrn||r  < 00  for  some  r > 0, 

n>l 


sup£||14||p  < 00  for  all  0 < p < r. 

n>  1 

Proof.  Let  0 < p < r and  note  that  for  n > 1 


■BIIK.II'  = B(||V„||'/(||V.||  < 1))  + B(||Kir/(||C„||  > 1)) 
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-1+K^'(r"ll>1) 

<l  + B(||K||r/(||KII>l)) 

< 1 + BIW- 


Thus 


supi?||K||p  < 1 + sup£'||Tri||r  < oo.  □ 


n>l 


Corollary  2.3.8.  (Taylor  and  Wei  (1979))  Let  { Vn , n > 1}  be  a uniformly  tight 
sequence  of  independent  random  elements  in  a real  separable  Banach  space  such  that 


Proof.  In  view  of  Lemma  2.3.2  it  may  be  assumed  that  1 < p < 2.  Let  bn  = 
n,  n > 1.  It  follows  from  (2.67)  that  the  sequence  of  random  variables  {||K,||,  n > 1} 
is  uniformly  integrable  (see  Chow  and  Teicher  (1997,  p.  102)).  Then  this  and  the 
uniform  tightness  hypothesis  ensure  that  the  sequence  {17,,  n > 1)-  is  compactly 
uniformly  integrable  (recall  the  discussion  in  Chapter  1).  Next,  by  (2.67)  there  exists 
a constant  C < oo  such  that  £7||V7,||P  < C,  n > 1 implying 


sup£,||F„||p  < oo  for  some  p > 1. 


(2.67) 


Then  the  SLLN 


(2.68) 


obtains. 


c 

— < oo 
np 
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since  p > 1.  The  conclusion  follows  from  Corollary  2.3.7.  □ 

2.3.3  SLLNs  for  Banach  Space  Valued  Summands  Irrespective  of  Then- 
Joint  Distributions 

The  last  three  theorems  of  this  section  also  establish  SLLNs  for  Banach  space 
valued  random  elements.  In  contrast  to  Theorem  2.3.1,  no  assumptions  are  imposed 
on  the  underlying  Banach  space  and  no  assumptions  are  being  made  regarding  the 
joint  distributions  of  the  random  elements  {Fn,  n > 1}  whose  marginal  distributions 
are  constrained  solely  by  (2.70),  (2.74),  and  (2.79),  respectively.  The  only  other 
work  that  we  are  aware  of  pertaining  to  the  SLLN  problem  where  the  results  obtain 
irrespective  of  the  joint  distributions  of  the  random  variables  or  random  elements  is 
that  of  Sawyer  (1966),  Chatterji  (1970),  Martikainen  and  Petrov  (1980),  Adler  and 
Rosalsky  (1987),  and  Choi  and  Sung  (1987)  (in  the  random  variable  case)  and  Choi 
and  Sung  (1987),  Adler,  Rosalsky,  and  Taylor  (1989),  Adler,  Rosalsky,  and  Taylor 
(1992b),  and  Adler  and  Rosalsky  (1995)  (in  the  random  element  case). 

The  following  theorem  is  a version  of  Theorem  2.3.1  with  p = 1 where  the  result 
is  obtained  without  the  assumption  of  independence  and  where  no  conditions  are 
imposed  on  the  underlying  Banach  space.  We  did  not  include  the  condition  (2.16) 
(with  p = 1)  in  view  of  Remark  2.3.1. 

Theorem  2.3.4.  Let  {P„,  n > 1}  be  a sequence  of  random  elements  (not  nec- 
essarily independent)  m a real  separable  Banach  space  and  let  {an,  n > 1}  and 
{bn,  n > 1}  be  sequences  of  positive  constants  with  bn  j"  oo  such  that 

n 

5>.  = 0(  hn) 

i=  1 


(2.69) 
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holds.  Suppose  that  for  some  A > 0 and  for  all  e > 0 

OO 

Z>{||K||>A&„}<oo 


(2.70) 


n= 1 


and 


OO  j 

£ J-E\\VnI(ean  < UK, ||  < A bn)  - E{VnI(ean  < \\Vn\\  < A6„))||  < oo.  (2.71) 

n= 1 n 


Then  the  SLLN 


1 n 

-Y,  [Vi  - £(V</(|M|  < A60))  -t  o a.c 

n 1=1 


obtains  irrespective  of  the  joint  distributions  of  the  { V„ , n > 1}. 

Proof.  Let  e > 0 be  arbitrary  and,  as  in  the  proof  of  Theorem  2.3.1,  define 

K<1)=K/(IIK||<£aj),  i>l 

if  = vj(ea,  < ||i;||  < a;..),  t>i 

and 

K,3)  = V,/(||Vi||  > A i > 1. 

Now  by  the  Beppo-Levi  theorem  and  (2.71) 


/ oo 

( V 

P„(2)  - EV?] 

\ 00 

P„(2)  - E\f] 

\ ^ 

V n=l 

bn 

' n=l 

bn 

< oo 
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and  hence 


< oc  a.c. 


Thus  by  the  Kronecker  lemma 


The  remainder  of  the  proof  follows  exactly  as  in  the  proof  of  Theorem  2.3.1  replacing 
(2.22)  with  (2.72).  □ 

The  next  result  is  a version  of  Theorem  2.3.4  where  the  truncated  expectations 
are  replaced  by  true  expectations.  Of  course,  in  contrast  to  Theorem  2.3.4,  it  must 
be  assumed  in  Theorem  2.3.5  that  the  underlying  sequence  of  random  elements  have 
expected  values. 

Theorem  2.3.5.  Let  { Vn , n > 1}  be  a sequence  of  random  elements  (not  nec- 
essarily independent)  in  a real  separable  Banach  space  and  suppose  the  {Vn,  n > 1} 
all  have  expected  values.  Let  {an,  n > 1}  and  {&„,  n > 1}  be  sequences  of  positive 
constants  with  bn  t oo  such  that 


n 


(2.73) 


holds.  Suppose  that  for  some  A > 0 and  for  all  e > 0 


OO 


T e{||Vr„||  > A6„)  < oo, 


(2.74) 
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if>(K/(IMI>AM)->0, 


t=l 


(2.75) 


and 


Then  the  SLLN 


^i'(Vi-EVl)  ->Oa.c. 


(2.77) 


obtains  irrespective  of  the  joint  distributions  of  the  { Vn , n > 1}. 

Proof.  By  Theorem  2.3.4,  the  conditions  (2.73),  (2.74),  and  (2.76)  ensure  that 
the  SLLN 


tributions  of  the  random  elements  { V^,,  n > 1}  and  without  any  restrictions  on  the 
underlying  Banach  space.  However,  as  will  be  shown  in  Examples  2.4.2  and  2.4.3, 
Theorems  2.3.6  and  2.3.1  are  distinctly  different  results  even  when  {Vn,  n > 1}  is 
a sequence  of  independent  random  elements  and  the  underlying  Banach  space  is  of 
Rademacher  type  p (1  < p < 2).  Observe  that  the  assumption  (2.78)  implies  that  the 
norming  sequence  { bn , n > 1}  approaches  oo  very  rapidly.  An  example  of  a sequence 
{bn,  n > 1}  satisfying  (2.78)  is  bn  = Bn , n > 1 where  B € (l,oo).  Another  example 
is  described  as  follows:  Let  e > 0,  bx  > 0,  and  let  bn  > e k,  n > 2.  Then  for 


obtains.  Combining  this  with  the  condition  (2.75)  yields  (2.77).  □ 

The  final  theorem  of  this  section  is  also  obtained  irrespective  of  the  joint  dis- 


n  > 2 
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J2bi 


n-l 


— bn  + bi  < bn  + — 


j=l 


and  so  { bn , n > 1}  satisfies  (2.78). 

Theorem  2.3.6.  Let  Sn  = n > 1 where  {Vn,  n > 1}  is  a sequence  of 

random  elements  (not  necessarily  independent)  in  a real  separable  Banach  space  and 
let  {&„,  n > 1}  6e  a sequence  of  positive  constants.  If 


X>,  = 0(M 


i=l 


and 


X>{||K,||>e6„}  < oo  for  all  e > 0, 


n= 1 


then  the  SLLN 


Sn 


0 a.c. 


obtains  irrespective  of  the  joint  distributions  of  the  {Vn,  n > 1}. 


(2.78) 


(2.79) 


(2.80) 


Proof.  Note  at  the  outset  that  (2.78)  guarantees  that  Ys'Zi  k = oo  and  hence 
b„-*  oo  again  using  (2.78).  It  follows  from  (2.79)  and  the  Borel-Cantelli  lemma  that 

P{  liminf  [||V^||  < ebn]  } = 1 for  all  e > 0.  (2.81) 
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Now  (2.78)  ensures  that  there  exists  a constant  0 < C < oo  such  that 

n 

^ bi  < Cbn,  n > 1. 

*=  1 

Then  for  arbitrary  e > 0,  with  probability  1, 


n 


E l|Vi||/(||K||  < rf()  E > eh) 

»=1 . t=l 

bn  bn 

n 

<£!;+^  (by(2.8I)) 

On  On 

< Ce  + o(l)  (by  (2.82)  and  bn  -»  oo). 


(2.82) 


Thus 


lim  sup 

n— ► oo 


< Ce  a.c. 


and  since  e > 0 is  arbitrary,  the  conclusion  (2.80)  follows.  □ 

Remark  2.3.8.  If  the  sequence  {Vn,  n > 1}  is  stochastically  dominated  by  a 
random  element  V in  the  sense  that  for  some  constant  0 < D < oo 


^{IIK||  >t}<  DP{\\DV\\  > t},  t > 0,  n > 1, 
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then  (2.79)  will  certainly  hold  if 

OO 

y:  P{||V||  > £&„}  < oo  for  all  e > 0.  (2.83) 

n= 1 

If  bn/na  | for  some  a > 0,  then  (2.83)  holds  if  the  series  therein  converges  for  some 
£ > 0.  (See  Lemma  3.2.4  of  Stout  (1974,  p.  131)  or,  for  a new  simple  proof,  Rosalsky 
(1985).) 

The  following  corollary  is  a version  of  Corollary  2.3.1  with  p — 1 where  the 
result  is  obtained  without  the  assumption  of  independence  and  where  no  conditions 
are  imposed  on  the  underlying  Banach  space.  Note  that  in  the  conclusion  (2.85)  the 
centering  sequence  is  the  0 sequence. 

Corollary  2.3.9.  Let  { V^,,  n > 1}  be  a sequence  of  random  elements  (not  neces- 
sarily independent)  in  a real  separable  Banach  space  and  let  {&„,  n > 1}  be  a sequence 
of  positive  constants  with  bnf  o o and 


E£ 


( nun  \ 

VH^II  + i’n/ 


< OO. 


(2.84) 


Then  the  SLLN 


1 . . 

o a-c ■ (2-85) 

bn  >=i 


obtains  irrespective  of  the  joint  distributions  of  the  {Vn,  n > 1}  . 

Proof.  By  an  argument  similar  to  that  of  Heyde  (1968),  the  condition  (2.84)  is 
equivalent  to  the  pair  of  conditions 


n=l 


(2.86) 
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and 

oo 

£r£(r„||/(||V„||<  !.„))<  °o. 

*,—1 
n=  1 

Condition  (2.87)  certainly  ensures  that 

°°  i 

£rJ5(||K||/(ea„  < ||V„||  < b„))  < oo 

n=l  °n 

for  all  £ > 0 and  for  any  choice  of  {an,  n > 1}.  Choose  in  particular  {a„, 
satisfy  (2.69).  Then 

(K  - B(K/(I|V;-||  < 0 a.c. 

0,1  i=  1 

follows  (2.86)  and  (2.88)  by  Theorem  2.3.4  with  A = 1. 

Next, 


< j^xr^ciiKii/diViii  < m)  -+° 


i=  1 


*=1 


by  (2.87)  and  the  Kronecker  lemma.  Thus 


J-X>(K/(||K||  <«)-+« 


i—1 


which  when  added  to  (2.89)  yields  (2.85). □ 


2.4  Some  Interesting  Examples/ Counterexamples 


(2.87) 

(2.88) 
n > 1}  to 

(2.89) 


In  this  section  we  present  examples  illustrating  various  aspects  of  the  main  results 
in  this  chapter.  The  first  example  revisits  Example  2.1.1  and  obtains  the  SLLN 
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therein  by  application  of  Theorem  2.3.1.  It  will  be  shown  in  Examples  2.4.2  and  2.4.3 
that  Theorems  2.3.1  and  2.3.6  are  different  results  even  when  the  random  elements  are 
independent.  Example  2.4.4  shows  that  Theorem  2.3.1  can  fail  without  the  hypothesis 
that  the  underlying  Banach  space  is  of  Rademacher  type  p and  also  that  Theorem  2.3.3 
can  fail  without  the  hypotheses  that  the  sequence  of  random  elements  is  compactly 
uniformly  integrable.  The  last  two  examples  of  this  section  investigate  Theorem  2.3.3 
as  compared  to  a similar  result  of  Adler,  Rosalsky,  and  Taylor  (1992a). 

It  will  now  be  shown  that  the  conclusion  in  Example  2.1.1  which  was  obtained 
by  first  principles  can  also  be  obtained  utilizing  Theorem  2.3.1.  Recall  that  Example 
2.1.1  illustrated  the  limitations  of  Proposition  2.1.1  and  thereby  motivated  Theorem 
2.3.1.  In  the  next  chapter  it  will  be  shown  that  Proposition  2.1.1  indeed  follows 
immediately  from  Theorem  2.3.1. 

Example  2.4.1.  Let  {AT„,  n > 1}  be  a sequence  of  independent  random  vari- 
ables and  {(*„,  n > 1}  be  a sequence  of  constants  with  1 < a„  f °°i  “T  = 

and 


P 


Xn  = 


J,  n>l. 


To  apply  Theorem  2.3.1,  since  the  real  line  is  of  Rademacher  type  p = 2,  set  X = M, 
P — 2,  and  Vn  = An,  n > 1.  Take  an  — bn  = 2n,  n > 1 and  note  that  condition 
(2.17)  of  Theorem  2.3.1  holds.  Letting  A = 1,  we  have  since  an  > 1 for  all  n > 1 that 

OO  OO  OO 

£ p{r»ll  > «„}  = £p{|at„|  > 2"}  = £o  < oo. 

n= 1 n=l  n=l 
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Now  let  0 < e < 1 and  n0  = min{n  >3:  a„  > e J}.  Then  we  have 


^2—E\\VnI(ean  < HKII  < A bn)  - E(VnI{ean  < ||V;||  < A5n))||p 

n= 1 

oo 

= E 5KVar(Jf„/(e2"  < \X„\  < 2")) 

n-1  Z 

no— 1 - oo  - 

= E ^7Var(.Y„/(e2"  < |X„|  < 2"))  + E ^rVar(A-„/(£2"  < |A'„|  < 2”)) 

w=l  n=n  o 

oo 

=C+E 

n=n0 


< OC. 


Hence  conditions  (2.18)  and  (2.19)  of  Theorem  2.3.1  are  also  satisfied  and  thus  the 
SLLN 

F E = F E (A‘‘  - E(X‘I(\X>\  < 2‘)))  ->  o a.c. 

i=l  i=l 

obtains. 


Remark  2.4.1.  It  follows  from  (2.5)  that  E\Xn\p/2np  — oo  and  hence  the 
sequence  {Xn,  n > 1}  in  Example  2.4.1  satisfies  the  hypotheses  of  Theorem  2.3.1  but 
not  those  of  Proposition  2.3.1.  This  observation  is  of  particular  interest  in  light  of 
the  fact  that  Proposition  2.3.1  played  a key  role  in  the  proof  of  Theorem  2.3.1. 

Theorems  2.3.1  and  2.3.6  are  distinctly  different  results  even  when  {K,,  n > 1} 
is  a sequence  of  independent  random  elements  and  the  underlying  Banach  space  is 
of  Rademacher  type  p (1  < p < 2)  as  will  be  shown  in  the  following  two  examples. 
With  respect  to  the  real  separable  Banach  space  £p  (where  p > 1)  of  absolute  p-th 
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power  summable  real  sequences  v = {vj,j  > 1}  with  norm  ||v||  = ( Xqli  \vj\PY^P^  let 
denote  the  element  having  1 in  its  n-th  position  and  0 elsewhere,  n > 1. 

In  Example  2.4.2,  the  hypotheses  of  Theorem  2.3.1  are  satisfied  but  those  of 
Theorem  2.3.6  are  not. 

Example  2.4.2.  Let  1 < p < 2 and  consider  the  real  separable  Rademacher 
type  p Banach  space  ip.  Let  a > 1 and  define  a sequence  n > 1}  of  independent 
random  elements  in  ip  by  requiring  the  {K,  n > 1}  to  be  independent  with 

p{v„  = n“»(n)}  = p{v„  = -nV">}  = i - = 0}  = n > 1 

where  { pn , n > 1}  is  a sequence  of  constants  with  pn  E (0, 1),  n > 1 and  Y^LiPn  < 
oo.  Let  bn  = n,  n > 1 and  note  that  Theorem  2.3.6  cannot  be  applied  since  (2.78) 
is  not  satisfied  with  this  choice  of  {&„,  n > 1}.  To  apply  Theorem  2.3.1,  choose 
an  = 1,  n > 1 and  A = 1.  Condition  (2.17)  holds  with  the  choice  of  sequences 
{an,  n > 1}  and  { bn , n > 1}  and  we  have  that  (2.18)  holds  since 

oo  oo  oo 

> A6»}  = X^ii^h  > nl  = YYpn  < °°- 

n= 1 n=l  n= 2 

Let  e > 0 and  note  that  (2.19)  holds  since 


1=2  n= 2 

Hence  the  hypotheses  of  Theorem  2.3.1  are  satisfied  and  so  the  SLLN 
l E V‘  = ^ E (V<  - ®(^(IIK'll  < i»)  -*  0 a.c. 

i=l  i=l 


obtains. 
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In  Example  2.4.3,  the  hypotheses  of  Theorem  2.3.6  are  satisfied  but  those  of 
Theorem  2.3.1  are  not. 

Example  2.4.3.  Let  1 < p < 2 and  consider  the  real  separable  Rademacher 
type  p Banach  space  £p.  Define  a sequence  {Vn,  n > 1}  of  independent  random 
elements  in  £p  by  requiring  the  { Vn , n > 1}  to  be  independent  with 


n > 1 


where  B 6 (1,  oo).  Let  bn  = Bn,  n > 1 and  note  that  (2.78)  is  satisfied.  Let  0 < e < 1 
and  choose  no  to  be  the  first  integer  n such  that  < e.  Then 


E 


no  — 1 


e{||v„ll  > ^"}  = J2  e{||v„||  >eB-}  + '£  p{\K\\  > eB"} 


n=l 


n—n0 


n o — l oo 

= E1+E0 

n=l  n=n() 


< OO. 


Hence  by  Theorem  2.3.6,  the  SLLN 


HU  Vi 

Bn 


— > 0 a.c. 


obtains. 

Next,  let  an  = 1,  n > 1 and  note  that  (2.16)  and  (2.17)  both  hold  with  the 
choice  of  sequences  {an,  n > 1}  and  {6„,  n > 1}  and  also  (2.18)  holds  via  the  same 
argument  presented  above.  Let  0 < e < B and  let  A > 0.  Now 


E[VnI(e  < IIKU  < \Bn))  = 0,  n > 1 
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and  hence  (2.19)  reduces  to 


°o 

E ^(||K„|f’/(£  < IIC.II  < AB"))  < oo. 

n—\ 

Let  n0  be  the  first  integer  n such  that  - < A and  note  that 


oo 

23-^K(||V„||«>J(e  < HV^II  < Ai3")) 


oo  1 

> E prM\V"\\rl(e  < llc.ll  < A B")) 

n—riQ 


n— no 


Bnp 
(log  n)p 


= E 

n=n0 


l 

(log  n)p 


= oo. 


Hence  the  hypotheses  of  Theorem  2.3.1  are  not  satisfied. 

The  following  example  of  Taylor  (1978)  and  of  Adler,  Rosalsky,  and  Taylor 
(1992a)  shows  that  the  Rademacher  type  p hypothesis  cannot  be  dispensed  with 
in  Theorem  2.3.1.  Recall  that  every  real  separable  Banach  space  is  of  Rademacher 
type  (at  least)  1 and  the  lp  spaces  are  of  Rademacher  type  2 Ap,  p > 1. 

Example  2.4.4.  Consider  the  real  separable  Banach  space  t\.  Define  a sequence 
{Hn,  n > 1}  of  independent  random  elements  in  l\  by  requiring  the  {Vn,  n > 1}  to 
be  independent  with 

P{V„  = = P{ V„  = -v^M}  = \ - ip{C„  =°}  = 2^.  " > 1. 
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Setting  an  = 1,  bn  = n,  n > 1 and  A = 1,  (2.17)  holds  and 

OO  OO  OO 

5Z ^{IIK.11  > A6„}  = £P{||V„||  > »}  = £o  < oo 

n=  1 n— 1 n=l 

establishing  (2.18).  Also  note  that  for  1 < p < 2 and  0 < e < 1 the  expression  in 
(2.19)  reduces  to 


£ < iiv.ii  < »» = E a (^)  - £ 4r 

n=l  n=l  n V V / r>=l  « 2 


< oo  (2.90) 


since  p > 1 thereby  establishing  (2.19).  It  was  verified  in  Taylor  (1978,  p.  128)  that 


ELi  K 


• p 


and  hence  (2.20)  fails.  (Alternatively,  by  the  structure  of  the  i\  norm  and  Kol- 
mogorov’s theorem  (see  Loeve  (1977,  p.  250))  applied  to  the  random  variables  {\/n 
/(HKII  = \/n),  n > 1},  it  follows  that 

IIELv.ll  EL  v^/(t|v.||  = Vi) 

7 = ¥ 1 a.c. 

on  n 


and  so  (2.20)  fails.) 

To  see  that  £i  is  not  of  Rademacher  type  p for  any  1 < p < 2,  define  a sequence 
{Wn,  n > 1}  of  independent  random  elements  in  £x  by  requiring  the  {Wn,  n > 1}  to 
be  independent  with 


= j.  «>!• 


p{h„  = »<”>}.  = = -„<”>} 
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Then  for  1 < p < 2, 


E 


E H'. 


1=1 


= np. 


Y,E\\Wi\\p  = n,  n > 1 
»=1 


whence  £x  is  not  of  Rademacher  type  p recalling  the  Hoffmann-Jprgensen  and  Pisier 
(1976)  characterization  of  Rademacher  type  p Banach  spaces.  Consequently,  Theorem 
2.3.1  can  fail  without  the  Rademacher  type  p hypothesis. 

Remark  2.4.2.  Example  2.4.4  also  shows  that  compact  uniform  integrability 
cannot  be  replaced  by  uniform  tightness  in  Theorem  2.3.3.  To  see  this,  first  note  that 
(2.90)  ensures  (2.52)  by  Remark  2.3.7.  Next,  let  e > 0,  select  N — Ne  such  that 
N~x/2  < e and  let 


Then  Ks  is  compact  and  for  n > 1 


P{Vn  <£  Ke } = 


0 < e,  if  n < N 
n_1//2  < e,  if  n > N. 


Thus,  {P„,  n > 1}  is  uniformly  tight.  However,  if  K is  any  compact  set,  then  K can 
contain  at  most  finitely  many  elements  of  {±s/nv(n\  n > 1}  and  so 


sxipE\\VnI(Vn  $K)\\  = \ 

n>  1 

thereby  showing  that  {Vn,  n > 1}  is  not  compactly  uniformly  integrable.  Therefore 
(2.53)  cannot  be  replaced  by  uniform  tightness  in  Theorem  2.3.3. 
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The  last  two  examples  pertain  to  Theorem  2.3.3  and  to  Corollary  2.3.7.  In 
Example  2.4.5,  the  hypotheses  of  Theorem  2.3.3  hold  but  not  those  of  Corollary 
2.3.7. 

Example  2.4.5.  Let  {An,  n>l}bea  sequence  of  independent  random  vari- 
ables with 


C{.Y„  = »>}  = P{X„  = -«’}  = = I - Ir{  A'„  = 0}.  » > 1. 

Note  that  EXn  = 0,  n > 1.  Since 

r?P{\X„\  = h2}  = A-  = o(l), 

it  follows  from  the  uniform  integrability  criterion  (see,  e.g.,  Chow  and  Teicher  (1997, 
p.  94))  that  the  sequence  {Xn,  n > 1}  is  (compactly)  uniformly  integrable.  Let 
bn  = n,  n > 1.  Note  that  for  every  1 < p < 2, 


E 

n= 1 


g|A'„p  _ 

K ^ npn2  log  n ^ n*~p  log  n 


00  2n  OO  - 

Enzp  ^ 1 

npri^  lncr  n ‘ J n^~P  1 r 


= OO 


since  2 — p < 1.  Hence  Corollary  2.3.7  cannot  be  applied. 

To  apply  Theorem  2.3.3,  let  an  = 1,  n > 1 and  A = 1.  Then  (2.50)  holds.  Now 


^ OO  OO  .. 

Ep{  W > A64  = T P{\Xn\  >n}=Y  < oo 

lo«" 


n=l 


n=2 


and  so  (2.51)  also  holds.  To  verify  (2.52),  let  1 < p < 2 and  note  that  for  all  e € (0, 1), 

°°  ^ oo 

E y;E(\X„\vI(ea„  < \X„\  < A b„))  = 1 + < oo. 


n— 2 
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Thus  the  conditions  of  Theorem  2.3.3  are  satisfied  and  so 


~EX>) 


«=1 


— >■  0 a.c. 


(2.91) 


Hence  the  conclusion  (2.66)  does  indeed  hold  by  Theorem  2.3.3  but  not  by  Corollary 
2.3.7.  It  may  be  noted  that  (2.91)  can  also  be  obtained  by  Theorem  2.3.2  recalling 
that  K is  of  Rademacher  type  p. 

Another  example  wherein  the  hypotheses  of  Theorem  2.3.3  hold  but  not  those  of 
Corollary  2.3.7  is  provided  by  Example  2.4.6  which  is  the  last  example  of  this  chapter. 
It  differs  from  Example  2.4.5  in  that: 

• Example  2.4.6  concerns  a sequence  of  random  elements  rather  than  a sequence 
of  random  variables. 

• The  random  elements  {F„,  n > 1}  in  Example  2.4.6  are  unbounded  whereas 
the  random  variables  {Xn,  n > 1}  in  Example  2.4.5  are  bounded. 

• Theorem  2.3.2  is  not  necessarily  applicable  in  Example  2.4.6  but,  as  was  noted 
above,  it  is  applicable  in  Example  2.4.5. 


Example  2.4.6.  Let  {Vn,  n > 1}  be  a uniformly  tight  sequence  of  independent 
random  elements  where  ||C„||  has  distribution  given  by 


P{  «>*}  = 


(log  n)a:(  log  ((logn)a:)) 


2 ’ — 1 5 ft  ^ 1. 

log  n 


Then  {Vni  n > 1}  is  stochastically  dominated  by  V\  and 


:r(logx) 


2 dx  = e + I — e(loga:) 


poo 

£|NI  = e+  / 

J e 


= 2e  < oo 
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which  combined  with  the  uniform  tightness  assumption  ensure  that  (see  Cuesta  and 
Matran  (1988))  the  sequence  { Vn , n > 1}  is  compactly  uniformly  integrable.  Let 
a„  = 1,  bn  = n,  n > 1 and  A = 1.  Now  for  all  n > 1, 


BIIK.II  > J 


-f 


log 

oo 


» (log  n)^r(log  ((logn.)ar))‘ 


dx 


t(logf)2(logra) 


dt 


and  hence 


logn 


£ 

n~  1 


E\K\\ 


= oo. 


n 


(2.92) 


Note  that  for  all  1 < p < 2 and  n > 1 


/CX 
log 

-i: 


xp  le 


- (log  n)z(  log  ((logn)^))' 


dx 


-l 


log 

oo 


- (log n)x2  p(log  ((logn)x))' 


dx 


(log  n)p  r p(logt) 


dt 


oo  (since  2 — p < 1). 


Thus,  recalling  (2.92), 


£ 

n=l 


E\\Vn\\P 

bt  ^ 


E\\Vn\\p 

— = oo  for  all  1 < p < 2 


71—1 


TV 
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and  so  Corollary  2.3.7  is  not  applicable. 

Take  p = 2.  Then  (2.49)  and  (2.50)  both  hold.  Moreover,  since  the  sequence 
{Vm  n > 1}  is  stochastically  dominated  by  Vi  (with  D = 1)  and  since  £'||Vi||  < oo, 

oo  oo 

EP{IMI  > M < EP{INI  > »}  < °°  (2.93) 

n—1  n=l 

whence  (2.51)  holds.  Next,  it  will  be  shown  that  (2.52)  holds.  In  view  of  Remark 

2.3.7,  it  suffices  to  show  that  for  all  e > 0 

E vrE(\K\\2I(ean  < \\Vn\\  < A bn))  < E 7j^(llK||2/(||Vn||  < bn))  < oo.  (2.94) 

n=l  » „=1  °rx 

To  this  end,  note  that 


and  recalling  (2.93),  we  have  by  Lemma  2.3.1  with  Yn  = ||V„||,  n > 1 and  Y = ||Vi|| 
that  (2.94)  holds.  Thus  (2.52)  is  established  and  so  by  Theorem  2.3.3 

l'Ev‘  = r'E(v‘-EVi)^o*.c. 

*=1  *=1 

Hence,  as  in  the  previous  example,  the  conclusion  (2.66)  does  indeed  hold  by  Theorem 
2.3.3  but  not  by  Corollary  2.3.7. 

Remark  2.4.3.  (i)  Note  that  if  the  underlying  Banach  space  is  not  of  Rade- 
macher  type  p for  any  1 < p < 2 (thus  the  Banach  space  is  only  of  Rademacher  type 
1),  then  apropos  of  Example  2.4.6  it  will  now  be  shown  that  condition  (2.32)  can 
fail  (with  p = 1)  and  so  Theorem  2.3.2  would  not  be  applicable.  Assume  that  Vn  is 


63 


symmetric,  n > 1.  Now  integration  by  parts  yields  for  all  n > 1 and  a > 0 

E(||C„||/(||Vn|l  < «))  = f P{  IIKII  >x}dx-  aP{\ |KII  > a). 

Jo 

Let  e > 0 be  arbitrary.  Then  for  all  large  n 


E(\\V„\\I(ea„  < IIKH  < Ai,„)) 

= £(IIK||/(£  < IIKII  < «)) 


= •BdlC.H/dlKII  < »))  - B(||K||/(||KII  < <=)) 

= f P{\m\>  x)  ix  - I’  P{\\V„\\>x}dx 
Jo  Jo 

-nP{||K||>n}+eP{||K||>e} 
> f PfllKII  >x}dx-  nP{||K||  > n) 

-[ 


dx-nP{\\Vn\\>n} 


\ 2 

(log n)x[  log  ((log  n)x)) 

krr*-"p{HKII>"} 

-nP{  IIKII  >n} 


rn  log  n 

e 

J s log  n 

t(logf)2  logn 

e 

log  n 

n log  n 

(log  t) 

elogn 

e 

> 


(log  n ) log(e  log  n)  (log  n)  ( log  n + log  log  n ) 

g 

r-Tj r; : nPlUV^H  > n}. 

2(logra)  log  log  n 1 1 


-nP{\\Vn\\>n} 
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Thus 


1 

VrB(||V„||/(ea„<||Vn||<»„)) 

■i  Vn 
n—l 

- C + (2n(logn)loglog„  ~ P<Hy4  > "}) 

OO 

= C + ^ — — — (by  (2.93)) 

2 ^ n(log  n ) log  log  n 

— oo 


and  so  (2.32)  fails  with  p = 1.  Since  the  { Vn , n > 1}  are  symmetric  and  £'||V^||  < 
oo,  n > 1,  (2.31)  holds.  Thus,  it  is  solely  the  failure  of  (2.32)  which  renders  Theorem 
2.3.2  inapplicable. 

(ii)  It  is  interesting  to  observe  that  the  sequence  of  random  elements  {V^,  n > 1} 
in  Example  2.4.6  does  not  satisfy  the  hypotheses  to  Theorem  7 of  Cuesta  and  Matran 
(1988)  solely  because 


dx  — oo. 


Remark  2.4.4.  In  the  next  chapter,  more  examples  will  be  presented  concerning 


various  aspects  of  Theorems  2.3.1  and  2.3.6. 


CHAPTER  3 

STRONG  LAWS  OF  LARGE  NUMBERS  FOR  SUMS  OF  RANDOM  VARIABLES 


3.1  Introduction 

Attention  will  now  be  focused  on  the  case  of  independent  random  variables. 
Since  the  real  line  is  a Banach  space  of  Rademacher  type  2,  we  can  get  special  cases 
of  the  results  given  in  the  previous  chapter.  Examples  will  be  given  illustrating  many 
aspects  of  these  results.  It  will  also  be  shown  that  Proposition  2.1.1  does  indeed 
follow  from  Theorem  2.3.1. 


3.2  Necessary  Conditions  for  a SLLN 


The  following  corollary  of  Theorem  2.2.1  is  a desymmetrized  version  of  Theorem 
2.2.1  for  the  random  variable  case.  Corollary  3.2.1  is  originally  due  to  Martikainen 
(1979)  with  a proof  totally  different  from  the  one  given  below. 


Corollary  3.2.1.  (Martikainen  (1979))  Let  {Vn,  n > 1}  be  a sequence  of  in- 
dependent random  variables  (not  all  degenerate)  and  let  S„  = )C"=i  AT,-,  n > 1.  If 


Sn  - med(5n) 

— y 0 cl.c, 

K 


(3.1) 


for  some  sequence  of  positive  constants  {bn,  n > 1},  then 


bn  — oo 


(3.2) 
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and 


Sn  - med(Sn) 


0 a.c. 


where  0 < 6*  = infj>n  bj  f oo. 


(3.3) 


Proof.  Let  {5®,  n > 1}  be  a symmetrized  version  of  {5„,  n > 1};  that  is, 
(Xi  — Xj),n  > 1 where  { X'n , n > 1}  is  a stochastic  process  independent 
of  {Xn,  n > 1}  with  the  same  distribution  as  {A'n,  n > 1}.  Then  by  (3.1) 


S^_  _ Sn  - med(5n)  _ S'n  - med(5^) 
bn  bn  bn 


where  S'n  = Xj,  n > 1 and  so  by  Theorem  2.2.1  we  have  that  (3.2)  and 


->  0 a.c. 


(3.4) 


hold.  The  conclusion  (3.3)  follows  immediately  from  (3.4)  and  the  strong  symmetriza- 
tion  inequality  (see,  e.g.,  Loeve  (1977,  p.  259)).  □ 


3.3  Sufficient  Conditions  for  a SLLN 


3.3.1  SLLNs  for  Sums  of  Independent  Random  Variables 

The  main  result  of  this  Chapter  may  now  be  stated.  Theorem  3.3.1  is  a special 
case  of  Theorem  2.3.1  since  the  real  line  is  of  Rademacher  type  2 (and  hence  is 
of  Rademacher  type  p for  all  1 < p < 2).  It  will  also  be  shown  that  Proposition 

2.1.1  follows  immediately  from  Theorem  3.3.1  and  therefore  from  Theorem  2.3.1.  A 
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sufficient  condition  for  (3.8)  is  of  course 

OO  - 

Y j»E{\Xn\pI{ean  < |Xn|  < A bn))  < oo. 

77—1  n 

Moreover,  if  {Ar„,  n > 1}  are  in  Cp  with  a bounded  sequence  of  absolute  pth  moments 
and  if  b~p  < oo,  then  (3.8)  is  automatic.  However,  note  that  there  are  no 
moment  conditions  imposed  in  Theorem  3.3.1  on  the  sequence  of  random  variables 
{A„,  n > 1). 

Theorem  3.3.1.  Let  {An,  n > 1}  be  a sequence  of  independent  random  vari- 
ables, let  1 < p < 2,  and  let  { an , n > 1}  and  { bn , n > 1}  be  sequences  of  positive 
constants  with  bn  f oo  such  that  either 


OO 


£ 

n=l 


f<“ 


(3.5) 


or 


n 

Yai=°{hr>)  (3-6) 

i=l 

hold.  Suppose  that  for  some  A > 0 and  all  e > 0 

OO 

> Xbn}  < oo  (3.7) 

72—  1 


Y WE\ Xnl{ean  < \Xn | < A bn)  - E{XnI{ean  < \Xn\  < A bn))  |p  < oo.  (3.8) 

n= 1 


and 
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Then  the  SLLN 

i n 

r J2  (Xi  ~ E(xiI(\xi\  < Xbi )))  -> 0 «-c-  (3.9) 

°n  i= i v 7 


obtains. 


Remark  3.3.1.  Note  that  when  p = 2,  condition  (3.8)  becomes 

oo  1 

5^  p-Var(X„/(ea„  < |Xn|  < A bn))  < oo. 

n=l 


The  next  result  is  a version  of  Theorem  3.3.1  where  the  truncated  expectations 
are  replaced  by  true  expectations.  Of  course,  in  contrast  to  Theorem  3.3.1,  it  must 
be  assumed  in  Theorem  3.3.2  that  the  underlying  sequence  of  random  variables  is  in 
Ci.  Theorem  3.3.2  follows  immediately  from  Theorem  2.3.2  by  taking  the  Banach 
space  to  be  the  real  line. 

Theorem  3.3.2.  Let  {Xn:  n > 1}  be  a sequence  of  independent  C\  random 
variables  and  let  1 < p < 2.  Let  {an,  n > 1}  and  {6„,  n > 1}  be  sequences  of  positive 
constants  with  bn  f oo  such  that  either 


°°  V 

if 

n=l  n 


< OO 


(3.10) 


or 


T ai  - °(bn) 

i=  1 


(3.11) 
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hold.  Suppose  that  for  some  A > 0 and  for  all  e > 0 

OO 

]TP{ |A'n|  > \bn}  < oo,  (3.12) 

n—  1 


J2E{XiI(\Xi\  > A bt))  = o(bn ),  (3.13) 

*=1 

and 


Y jvE\XnI(ean  < \Xn\  < A bn)  - E(XnI(ean  < \Xn\  < A6n))|p  < oo.  (3.14) 

n= 1 


T/jen  ^/ie  SLLN 


1 

— ^ (A,-  - EXi)  ->  0 a.c. 

n i- 1 

obtains. 

Remark  3.3.2.  It  will  now  be  shown  that  Proposition  2.1.1  follows  immediately 
from  Theorem  3.3.1.  Upon  inspection  of  the  hypotheses  of  Theorem  3.3.1  it  is  not 
immediately  obvious  that  Proposition  2.1.1  follows  since  conditions  (3.5)  or  (3.6) 
appear  in  addition  to  conditions  (3.7)  and  (3.8)  which  correspond  to  conditions  (2.3) 
and  (2.4)  of  Proposition  2.1.1. 

Proof  of  Proposition  2.1.1.  Let  A = 1,  p = 2 and  set  b0  = 0 and  an  = 
bn  - 6„_ i,  n > 1.  Assume  the  hypotheses  of  Proposition  2.1.1.  Clearly  (2.4)  implies 
(3.8)  (with  p = 2)  for  every  e > 0.  Since  (3.6)  is  automatic  with  the  above  choice  of 
{an,n  > 1},  Proposition  2.1.1  follows  directly  from  Theorem  3.3.1.  □ 
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Remark  3.3.3.  Proposition  2.1.1  can  of  course  also  be  obtained  directly  from 


Corollary  2.3.1  with  X — M and  p = 2. 

The  next  theorem  is  a special  case  of  Theorem  2.3.3  where  the  Banach  space  X 
is  chosen  to  be  the  real  line. 

Theorem  3.3.3.  Let  { Xn , n >1}  be  a sequence  of  independent  random  vari- 
ables, let  1 < p < 2,  and  let  {a„,  n > 1}  and  { bn , n > 1}  be  sequences  of  positive 
constants  with  bn  t and  n = 0(bn)  such  that  either 


or 


n 


hold.  Suppose  that  for  some  A > 0 and  for  all  e > 0 


OO 


J2P{\Xn\>\bn}<OC 


n=l 


and 


Then  if 


{A'n,  n > 1}  is  uniformly  mtegrable, 


the  SLLN 


obtains. 
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Since  the  real  line  is  of  Rademacher  type  p for  every  1 < p < 2,  the  first  corollary 


to  be  the  real  line.  Proposition  2.1.1  is  the  special  case  p — 2.  However,  since  the 
assumption  (3.15)  is  weakest  with  p — 2 (see  Remark  2.3.6),  the  corollary  is  strongest 
when  p — 2 (as  in  Proposition  2.1.1). 

Corollary  3.3.1.  Let  {.Yn,  n > 1}  be  a sequence  of  independent  random  vari- 
ables and  let  {&„,  n > 1}  be  a sequence  of  positive  constants  with  bnf  oo  and 


obtains. 

The  next  corollary  is  a special  case  of  Corollary  2.3.2  where  the  Banach  space  is 
chosen  to  be  the  real  line. 

Corollary  3.3.2.  Let  n > 1}  be  a sequence  of  independent  C\  random 

variables  and  let  {&„,  n >1}  be  a sequence  of  positive  constants  with  bn  f oo, 


of  this  chapter  follows  immediately  from  Corollary  2.3.1  by  taking  the  Banach  space 


(3.15) 


Then  the  SLLN 


and 


n 


Y.E(XiI(\Xi\>b,j)=o(b„). 
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Then  the  SLLN 

1 ” 

- £ (Xi  - EXi)  — > 0 a.c. 

On  - , 

2—1 

obtains. 

Recall  that  in  the  random  variable  case  the  Kolmogorov  SLLN  was  generalized  by 
the  Marcinkiewicz-Zygmund  SLLN  which,  in  turn,  was  generalized  by  Feller  (1946). 
As  a result  of  Corollary  2.3.3,  Theorem  2.3.1  yields  these  well-known  results.  The 
first  corollary  presented  is  the  famous  result  of  Feller  (1946)  which  is  a special  case 
of  Corollary  2.3.3  with  X = M,  a = 1/(1  + s)  (where  0 < e < 1),  and  p = 2. 

Corollary  3.3.3.  (Feller  (1946))  Let  Sn  = £"=1  Xit  n > 1 where  {Xn,  n > 1} 
is  a sequence  of  i.i.d.  mean  0 random  variables  and  let  { bn , n > 1}  be  a sequence  of 
positive  constants.  Suppose 


and  'rii/(\+£)  t for  some  0 < e < 1. 


If 


OO 

5^P{|X„|  > bn } < 00, 

then 

Sn  n 
> 0 a.c. 

K 

The  next  corollary  is  the  famous  Marcinkiewicz-Zygmund  (1937)  SLLN  which 
follows  immediately  from  Corollary  3.3.3. 
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Corollary  3.3.4.  (Marcinkiewicz  and  Zygmund  (1937))  Let  Sn  = XlLi  n > 
1 where  {X„,  n > 1}  is  a sequence  of  i.i.d.  Cr  random  variables  for  some  r £ [1,2). 
Then  the  SLLN 


obtains. 


Sn  - nEXx 
nl'r 


—>  0 a.c. 


The  next  lemma  is  due  to  Marcinkiewicz  and  Zygmund  (1937).  It  may  also  be 
found  in  Chow  and  Teicher  (1997,  p.  118).  This  lemma  will  be  utilized  to  establish 
the  next  corollary. 

Lemma  3.3.1.  (Marcinkiewicz  and  Zygmund  (1937))  For  any  a > r > 0 and 
Cr  random  variable  X, 

OO 

J2n~a/rE{\X\aI(\X\  < nl'r))  < oo. 

n= 1 

The  following  corollary  is  the  renowned  Kolmogorov  (1933)  SLLN  for  i.i.d.  Ci 
random  variables.  It  is  of  course  well  known  that  the  Kolmogorov  SLLN  is  a spe- 
cial case  of  the  Marcinkiewicz-Zygmund  SLLN  (Corollary  3.3.4).  Nevertheless,  it 
will  be  shown  in  Corollary  3.3.5  that  Theorem  3.3.2  does  indeed  directly  yield  the 
Kolmogorov  SLLN. 

Corollary  3.3.5.  (Kolmogorov  (1933))  Let  Sn  = ]T"=1  X,,  n > 1 where  {Xnin  > 
1 } is  a sequence  of  i.i.d.  C\  random  variables.  Then  the  SLLN 


— EXx  a.c. 
n 


obtains. 
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Proof.  We  will  verify  that  the  hypotheses  of  Theorem  3.3.2  are  satisfied  with 
an  = 1,  bn  = n,  n > 1,  p = 2,  and  A = 1.  Firstly,  note  that  (3.10)  and  (3.11)  are 
immediate  and  that 


OO  CO 

E P{|V„|  > n}  = E P{|X,|  > n}  < oo, 

n= 1 n=l 

since  X\  £ C\  thereby  verifying  (3.12). 

Next,  by  Lebesgue  dominated  convergence  theorem,  we  have 


E(XJ (|Xj|  < n))  -+EXx. 


Thus 


E(XJ (\Xi\  > n))  = EXy  - E{X1I(\X1\  < n))  -4  0, 


and  hence  by  the  Cesaro  mean  summability  theorem 

i£>(V,/(|V1|>i))-tO. 

t=l 


Thus 


1=1 

thereby  verifying  (3.13). 

Finally,  to  verify  (3.14),  note  that 

E ^Var (X„I(e  < |A-„|  < n))  < E ~E{X2„I(e  < \X„\  < „)) 

n=l  n=l 


75 


1 

< E -jE(X*J(\X„\  < n)) 

n—1  U 
°°  1 

= E -^E(xil(ixi\  ^ n» 

n=l  71 

< 00 


by  Lemma  3.3.1  with  a = 2 and  r = 1.  Thus  by  Theorem  3.3.2  we  have 

1 n 

- ]T  ( Xi  - EXi)  ->  0 a.c., 

i=l 

and  since  {X„,  n > 1}  are  i.i.d.  the  SLLN 


n 


- £Ar!  = 


Sn  - nEXj 

n 


— > 0 a.c. 


thus  obtains.  □ 

The  next  two  corollaries  are  special  cases  of  Corollaries  2.3.4  and  2.3.5,  respec- 
tively with  X — R. 

Corollary  3.3.6.  Let  {Xn,  n > 1}  be  a sequence  of  independent  random  vari- 
ables and  let  {&„,  n > 1}  be  a sequence  of  positive  constants  with  bn  | 00  and  set 
b0  = 0.  Suppose  that  for  some  A > 0,  some  1 < p < 2 and  all  e > 0 


J^P{\Xn\>  \bn}  <oc, 

n= 1 


2 

E ¥E\XnI(e(bn  - 6n_0  < |XB|  < \bn) 

n=l 


and 
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- E(XnI(e(bn  - 6n_x)  < \Xn\  < A6„))|p  < oo. 

Then  the  SLLN 

1 n 

rE  (X‘  - < A4„)))  -»  0 O.C. 

i=l 

obtains. 

Corollary  3.3.7.  Let  { Xn , n > 1}  be  independent  C\  random  variables  and  let 
{&„,  n > 1}  be  a sequence  of  positive  constants  with  bn  f oo  and  set  b0  = 0.  Suppose 
that  for  some  A > 0,  some  1 < p < 2 and  all  e > 0 

OO 

£>{|X„|>A6„}<oo, 

n=l 

n 

1=1 

and 

~ 1 

jjE\XnI(e(bn  — bn- 1)  < \Xn\  < \bn) 

n= 1 

- E(XnI(e(bn  — fe„_i)  < |X„|  < A6n))|p  < oo. 


Then  the  SLLN 


f E (*  - E*<)  -* 0 


a.c. 


»=i 


obtains. 
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Remark  3.3.4.  The  proof  of  Corollary  3.3.6  (resp.,  Corollary  3.3.7)  can  also  be 
obtained  by  direct  application  of  Theorem  3.3.1  (resp.,  Theorem  3.3.2). 

3.3.2  SLLNs  for  Random  Variable  Summands  Irrespective  of  Their  Joint 
Distributions 

The  next  theorem  follows  immediately  from  Theorem  2.3.4  by  taking  the  Banach 
space  to  be  the  real  line. 

Theorem  3.3.4.  Let  {AT,  n > 1}  be  a sequence  of  random  variables  (not  nec- 
essarily independent)  and  let  {an,  n > 1}  and  { bn , n > 1}  be  sequences  of  positive 
constants  with  bn  f oo  such  that 


n 


^2  ai  = °(bn) 


holds.  Suppose  that  for  some  A > 0 and  for  all  e > 0 


OO 


S>{|*n|  > A bn}  < oo 


and 


Then  the  SLLN 


obtains  irrespective  of  the  joint  distributions  of  the  {AT,  n > 1}. 
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The  next  result  is  a version  of  Theorem  3.3.4  where  the  truncated  expectations 
are  replaced  by  true  expectations.  Of  course,  in  contrast  to  Theorem  3.3.4,  it  must 
be  assumed  in  Theorem  3.3.5  that  the  underlying  sequence  of  random  variables  is  in 
C\.  Theorem  3.3.5  follows  immediately  from  Theorem  2.3.5  by  taking  the  Banach 
space  to  be  the  real  line. 

Theorem  3.3.5.  Let  {X„,  n > 1}  be  a sequence  of  £ i random  variables  (not 
necessarily  independent)  and  let  {an,  n > 1}  and  { bn , n > 1}  be  sequences  of  positive 
constants  with  bn  f oo  such  that 

n 

a,-  = 0(bn) 
i=  i 

holds.  Suppose  that  for  some  A > 0 and  for  all  e > 0 

(X) 

^P{|A„|>A6n}<oo, 

n=l 


£ EpCi/dJfil  > Ai>,))  = o(bn), 

i= 1 

and 


1 

^2  7-E\XnI{ean  < |An|  < A bn)  - E(XnI(ean  < |Xn|  < A6„))|  < oo. 

n—l  °n 


Then  the  SLLN 


1 " 

— ^2  (At  — EXf)  — > 0 a.c. 


1=1 


obtains  irrespective  of  the  joint  distributions  of  the  {Xni  n > 1}. 
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The  following  theorem  is  a special  case  of  Theorem  2.3.6  where  the  Banach  space 
is  chosen  to  be  the  real  line. 

Theorem  3.3.6.  Let  Sn  — ^"=1  n S 1 where  {Xn,  n > 1}  is  a sequence  of 
random  variables  (not  necessarily  independent)  and  let  {bn,  n > 1}  be  a sequence  of 
positive  constants.  If 

n 

Y,bi=0(br>)  (3-16) 

i=l 

and 


then  the  SLLN 


OO 

£p{ix,l>d>4  < oo  for  all  e > 0, 

n= 1 


Sn 

bn 


0 a.c. 


(3.17) 


(3.18) 


obtains  irrespective  of  the  joint  distributions  of  the  {A'n,  n > 1}. 

The  next  corollary  is  a special  case  of  Corollary  2.3.9  where  the  Banach  space  is 
chosen  to  be  the  real  line. 


Corollary  3.3.8.  Let  { Xn , n > 1}  be  a sequence  of  random  variables  (not 
necessarily  independent)  and  let  {brn  n > 1}  be  a sequence  of  positive  constants  with 
bn  t oo  and 


T,e 


\X„\  + b„ 


< 00. 
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Then  the  SLLN 


T~  Xi  — > 0 a.c. 

°n  ,=i 

obtains  irrespective  of  the  joint  distributions  of  the  {A”n,ra  >1}. 

3.4  Some  Interesting  Examples/ Counterexamples 

In  this  section  examples  will  be  presented  providing  insight  into  the  results  of 
this  chapter  as  well  as  Theorems  2.3.1  and  2.3.6.  Examples  3.4.1  and  3.4.2  show  that 
Theorem  3.3.1  is  an  extension  of  the  motivating  result,  our  Proposition  2.1.1,  which 
was  due  to  Heyde  (1968).  Examples  3.4.3  and  3.4.4  show  that  Theorem  3.3.1  (resp., 
Theorem  2.3.1)  can  fail  if  the  conditions  (3.5)  and  (3.6)  (resp.,  (2.16)  and  (2.17))  are 
dispensed  with.  A special  case  is  presented  in  Example  3.4.5  wherein  the  normed 
partial  sums  converge  to  1 a.c.  The  final  example  (Example  3.4.6)  of  this  section 
illustrates  the  sharpness  of  Theorems  2.3.6  and  3.3.6  as  well  as  demonstrates  that 
Theorem  2.3.6  (resp.,  Theorem  3.3.6)  can  fail  if  the  condition  (2.79)  (resp.,  (3.17))  is 
dispensed  with. 

The  next  two  examples  satisfy  the  hypotheses  of  Theorem  3.3.1  but  not  those 
of  Proposition  2.1.1  thereby  showing  that  Theorem  3.3.1  is  a bona  fide  extension  of 
Proposition  2.1.1. 

Example  3.4.1.  Let  {pn,  n > 1}  be  a sequence  of  constants  in  [0, 1]  with 

OO 

y ,pn  < oo 

n=l 


(3.19) 
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and  let  {A'n,  n > 1}  be  a sequence  of  independent  random  variables  with  distributions 
given  by  P{X i = 0}  = P{X 2 = 0}  = 1 and 

P{xn  = n"}  = 1 - p\xn  = = pn,  n > 3. 

Let  bn  = 2",  n > 1,  and  note  that  (2.4)  is  not  satisfied  in  view  of 

OO  - OO  . 

E 7yfi(v„2/(|x„|  < *„))  = E srB(x2/(|jf„|  < 2")) 

n=l  n=3  ^ 

22»  \ 

S 22n  V(logn)V 

OO  i 

— V ^ ~~ 

_^(l°gn)2 

00  1 OO 

_ y-  1 Pn 

~3  (!ogn)2  (logn)2 

= OO 

since  the  first  series  diverges  and  due  to  (3.19)  the  second  series  converges.  Hence  by 
Remark  2.1.1,  Proposition  2.1.1  cannot  be  applied.  However,  setting  an  = 2",  n > 1, 
condition  (3.6)  of  Theorem  3.3.1  holds.  Note  that  we  also  have  by  (3.19) 

OOOOOO 

Ep{i*»i  > M = Epi  w > 2”}  = E?"  < 00 

n=l  n=l  n= 3 

and  if  we  let  0 < e < 1 and  let  no  = min{n  > 3:  logn  > e-1}  then  we  have 
YlJ Var(ATn/(ean  < \Xn\  < bn))  = r^-Var(X„/(e T < |X„|  < 2n)) 

n=l  °n  n=l  1 
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no—l  ..  oo  1 

= E ^Var(*„/(£2"  < pr.|  < 2"))  + £ ^VarfX J(e2"  < \X„\  < 2")) 

n=l  n=no 

oo 

< C + E 5 ^E(XII(e2"  < |X„|  < 2”)) 

n=riQ 

oo 

=C+E 

n=n0 


< OO . 


Hence  conditions  (3.7)  and  (3.8)  (with  A = 1 and  p — 2)  of  Theorem  3.3.1  are  also 
satisfied  and  thus  the  SLLN 

1 n 

?E(*-  < 2'»)  0 a.c. 

1=1 

obtains  where  jB(X,-/(|X,-|  < 2’))  = , i > 3. 

Remark  3.4.1.  The  sequence  of  random  variables  { Xn , n > 1}  in  Example 
3.4.1  satisfies  the  conditions  of  Theorem  3.3.4  but  not  those  of  Corollary  3.3.8.  This 
can  be  seen  by  a slight  modification  of  the  argument  in  Example  3.4.1  and  the  details 
are  left  to  the  reader. 

The  following  example  is  similar  in  nature  to  Example  3.4.1  in  that  it  also  re- 
veals the  limitations  of  Proposition  2.1.1.  It  has  the  added  interest  that  the  random 
variables  {X„,  n > 1}  are  unbounded  with  EXn  = oo,  n > 1. 

Example  3.4.2.  Let  c > 1 be  such  that  cn  > logn  for  all  n > 1 and  let 
n > 1}  be  a sequence  of  independent  random  variables  with  corresponding 
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densities 


c” -log")  log”  C"-1  , ^ _£ 

2n—  1 / ~ ^ i V \ 


/n(«)  = < 


(?n~l{c-  1)’  loS" 

_1_ 
x 2 

0, 


j.2  , 


log  n 


ar  > » n>  L 

log  n 


elsewhere 


Note  that  for  all  n > 1 


/*oo  /»oo  ^ 

EXn  = / xfn(x)  dx>  — dx  = 

Jo  x 

log  n 


00. 


Let  an  = bn  = cn , n > 1 and  note  that 


oo 

^-5-£(^/(|X„|  < b„)) 


n=l  n 


o° 

= E 3t£(.0(W  < O) 


n=l 


00  ^ 1 

E / *2/n(*) 

n=l  C -70 


= E 

n=l 


■og"  20°gn)(c"  — logn) 


in 


cn~‘ 
log  I> 


X 


c2n-i(c  _ 


dx  + 


/»cn 
log  n 


1 dx 


E± 


1 / (log  n)(cn  — logn)  x3 


n= 1 

OO 

E 

n= 1 
00  / ^3 


c2n-1(c  — 1)  3 


Io*»  „n 

+ cn--— 
e.-l  l°g n 


log  n 


1_  / (c3  - l)(cn  - log  n)c3n  3 t c”(logn  — 1) 

2 2n— 1 •" 


in 


3 (c  — 1)  (log  n)2c2 


logn 


_ v-'  / c”  — 1 c"  — log  n log  n — 1 
\3(c  - 1)  cn+2(log  n)2  + c"  log  n 
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=j_ziYf  1 

3(c~  !)  c2(logn)2 


E 


oo 


+E 

n—1 


log  n — 1 
c” log  n 


= 00 


since  the  first  series  diverges  and  (since  c > 1)  the  second  and  third  series  converge. 
Thus  Proposition  2.1.1  does  not  apply  to  this  example.  It  will  now  be  shown  that 
Theorem  3.3.1  is  applicable.  Firstly,  condition  (3.6)  holds  due  to  the  definition  of 
{an,  n > 1}  and  { bn , n > 1}.  To  verify  condition  (3.7),  note  that 

OO  OO  /»00  1 00  1 

p{|x„l>M  = Ep{lx»l><:’‘}  = E / -i*  = E^<0° 

«=1  n=l  n=l  Jcn  X n=l 


E 


since  c > 1.  Finally,  to  verify  (3.8)  (with  p — 2),  let  0 < e < 1 and  let  no  = min{n  > 
3:  logn  > £-1}  and  note  that 


°o 

E 7jVar(XnI (ean  < \X„\  < b„)) 


n=l  n 


oo 

= E — ' Var(X„/(£c"  < \Xn\  < c”)) 

n=l  C 
oo  . 

5 E < IVnl  < C”)) 


r*=l 


°°^  i r°n 

= / *2/n(z)  dx 

»=1  ec 

"0—1  J OO  „c" 

= z dx  + ^ ~2n  / 1 dx 

n=l  Jecn  n=n0  Jecn 

oo 

= C+E^nd-^) 


n=n0 
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OO  - 

=^+Ei9£ 


n=n  o 


< 00 


again  since  c > 1.  Thus  by  Theorem  3.3.1 

1 n 

? E fy  - < c‘)))  ->  o a.c. 

i=l 

These  examples  again  illustrate  some  limitations  of  Proposition  2.1.1;  on  the 
other  hand  they  satisfy  the  conditions  of  Theorem  3.3.1.  Note  that  condition  (3.8) 
(with  p = 2)  of  Theorem  3.3.1  is  a weaker  condition  than  the  corresponding  condition 

(2.4)  of  Proposition  2.1.1.  Although  Theorem  3.3.1  contains  the  additional  condition 

(3.5)  or  (3.6),  we  have  shown  after  Theorem  3.3.2  that  Proposition  2.1.1  follows 
immediately  from  Theorem  3.3.1.  Another  example  of  a sequence  of  random  variables 
satisfying  the  conditions  of  Theorem  3.3.1  but  not  those  of  Proposition  2.1.1  can  be 
obtained  by  a slight  modification  of  Example  2.3.1  and  the  details  are  left  to  the 
reader. 

Remark  3.4.2.  If  {A'„,n  > 1}  is  a sequence  of  independent  and  symmetric 
random  variables  satisfying  the  conditions  of  Theorem  3.3.1  with  A = 1 and  with 

(3.5)  holding , then  recalling  Remarks  2.3.6  and  2.1.1,  it  is  easy  to  see  that  all  of  the 
conditions  of  Proposition  2.1.1  are  satisfied.  Hence,  in  such  a case , Theorem  3.3.1 
is  not  an  improvement  over  Proposition  2.1.1.  However,  in  Examples  2.1.1  and  2.4.1 
we  presented  a sequence  of  symmetric  random  variables  {Xn,n  > 1}  satisfying  the 
conditions  of  Theorem  3.3.1  with  A = 1 and  with  (3.6)  holding  but  such  that  the 
condition  (2.1)  of  Proposition  2.1.1  is  not  satisfied.  (The  random  variables  in  the 
previous  two  examples  were  very  asymmetric.) 
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The  following  two  examples  show  that  Theorem  3.3.1  (resp.,  Theorem  2.3.1)  can 
fail  if  the  conditions  (3.5)  and  (3.6)  (resp.,  (2.16)  and  (2.17))  are  dispensed  with. 

Example  3.4.3.  Let  Sn  = X{,  n > 1 where  { Xn , n > 1}  is  a sequence 

of  i.i.d.  symmetric  bounded  random  variables  with  EXf  = a2  > 0.  Let  p — 2,  A = 
1,  an  = «1//4  and  bn  = n1/2,  n > 1.  Now  by  the  Levy  central  limit  theorem, 

n~l/2S„  iV(0,<72), 


and  thus  for  arbitrary  M > 1, 


{oo  oo 

nu 

n=l  k—n 
( oo 

= lim  Pi  I I 

n — ►oo  I 


Sk 

k1'2  “ 


> M 


k~r\ 


Sk 

k1'2 


> M 


> lim  sup  P 


n— ► oo 


{J^M} 


=f 


>0. 


y/2n  a 


e-t2/2(T2  dt 


Hence  by  the  Kolmogorov  0-1  law, 


P \ lim  sup  > m\ — 

L n-y oo  n J 
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Thus 


P<  limsup 


n— K50  Tl 


Sn 

1/2 


= 00  > = P 


n 

M= 1 


lim  sup  > 

n-»  oo  nV'1 


M 


1, 


and  so 


Therefore 


limsup  —At  = oo  a.c. 

n— »-oo 


(3.20) 


1 M 

lim  sup  — (■*»'  “ < A6,)))  = oo  a.c. 


and  hence  (3.9)  fails.  In  view  of  Xx  being  bounded,  (3.7)  and  (3.8)  are  automatic 
since  the  terms  in  those  series  are  0 for  all  large  n.  Finally,  note  that  (3.5)  fails  since 


and  (3.6)  also  fails  since 


E “•  = E ,:‘/4  = <!  + °( l))l"5/4  * 0(n'/% 


1=1  1=1 


Remark  3.4.3.  Assertion  (3.20)  also  follows  immediately  from  the  Hartman 
and  Wintner  (1941)  law  of  the  iterated  logarithm 


lim  sup  _. ...  n.  = 
n— >oo  ynloglogn 


= y/2a  a.c. 


In  the  next  example,  the  sequence  {X„,  n > 1}  is  comprised  of  unbounded 


random  variables. 
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Example  3.4.4.  Let  {X„,  n > 1}  be  a sequence  of  i.i.d.  standard  normal 
random  variables.  Let  p = 2,  A = 1,  a„  = n1//4,  and  bn  = n1/2,  n > 1.  Since  trivially 

n 

4iV(0,l), 

2—1 

by  the  same  argument  as  the  previous  example,  we  have 

1 22 

limsup-ijV  (Xi  - E(XiI(\Xi\  < Xbi)))  = oo  a.c. 

n — ^oo  TT  . 1 ' ' 

2=1 

and  hence  (3.9)  fails.  Now  EX%  < oo  ensures  that 

OO  OO 

J2  p{ix"i  > «1/2}  = E p{ix!i  > nl/ 2}  < 00 

n=l  n=l 

and  thus  (3.7)  holds.  Next,  choose  x0  > 0 such  that 

x2  < x for  all  x > xq. 


(3.21) 


Let  0 < £ < 1 and  let  n0  be  the  first  integer  n > 2 such  that  en1/4  > x0.  Then 
” 1 

-Var(X nI(ea„  < \Xn\  < A bn)) 

n=l 


oo 

= £ -£(*?/(en1/4  < |V,|  < n1/2)) 

n=  1 
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<C  + 


dx 


<c+j2 


n=n0 


2 c~e»1/4 

n\/ 


(by  (3.21)) 


< oo 

and  thus  (3.8)  holds.  Finally  (3.5)  and  (3.6)  fail  as  was  verified  in  the  previous 
example. 

The  following  example  illustrates  a special  case  of  Theorem  3.3.2  wherein  we 
define  the  specific  sequences  {a„  = EX„,  n > 1}  and  { bn  = EXi,  n > 1}  and 
the  resulting  SLLN  takes  the  form  -4  1 a.c.  where  Sn  = n > 1. 

Example  3.4.5.  Let  Sn  = X n > 1 where  X\  = 1 a.c.  and  {Xn,  n > 2} 

is  a sequence  of  independent  random  variables  with  corresponding  densities 


fn(x)  = 


I2"2-1)2  Q < x < 4n(n-l) 
8n3(n— 1)  ’ u ^ x — 2«2_l 


r3  ’ 


x > n 
elsewhere 


, n > 2. 


Note  that  for  n > 2 


4«.(n  — 1) 


EX„  = 


(2n2  — l)2  , Z100  1 , 

n = X-T7 TT  / Xdx+  — dx 

8n3(n  - 1)  J0  Jn  x 2 

(2n2  — l)2  16n2(n  — l)2  1 

8n3(n—  1)  2(2n2  — l)2  n 


n — 1 1 

1 — 

n n 


Setting  an  = EXn  = 1,  bn  = EX{  — n,  n > l and  A = 1 we  have  that 


/*00  1 1 

£P{|*.|>M=£e{|X„|>»}=X^  _rfI  = ^_< 


n=l 


n=2 


rc=2 


00. 


Also  note  that 


oo 

£ rE<*»w 

n— 1 °n 


< 00 


and  hence  by  the  Kronecker  lemma 


±f'E(XtI(Xi>i))-f  0. 

°n  : — i 


Finally  we  have  for  all  e > 0 


00  1 

£ rrVai(XJ(ea„  < \Xn\  < b„))  < Y ~^E{X2J(Xn  < n)) 

n=l  °«  n= 1 ” 

OO  /r.  9 ,No  4n(n-l) 

- 1 i v 1 (2n  ~ x) 

n28n3(n  - 1)  J0 


! . f'l  8(n  ~ ^ 

3(2n2  — 1) 

n= 2 7 

< 00 


and  thus  by  Theorem  3.3.2  the  SLLN 


1 " 

rzA*'  — -EAT,-)  — > 0 a.c. 


i=i 
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obtains.  Hence  we  have 

Sn  . 

y 1 a.c. 

K 

The  following  result  of  Rosalsky  (1993)  will  be  used  in  the  ensuing  example. 

Proposition  3.4.1.  (Rosalsky  (1993))  Let  Sn  = Xi,  n > 1 where  { Xn , 
n > 1}  is  a sequence  of  independent  random  variables  and  let  {Bn,  n > 1}  be  a 
sequence  of  positive  constants  with  Bn  -4  oo. 

(i)  Suppose  there  exist  constants  0 < M < oo  and  6 > 0 such  that  for  all  large  n 


If 


* -M} a * 


limsup 

n—yoo 


X, 

B 


— oo  a.c., 


then 


Sn 


: co  n r 


(ii)  Suppose  there  exist  constants  0 < M < oc  and  S > 0 such  that  for  all  large  n 


^ m}  s *• 


if 


lim  inf  — - = — oo  a.c., 

n-yoo  Bn 
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then 


liminf  — — oo  a.c. 
n-¥oo  Bn 


The  following  example  concerns  the  SLLN  problem  for  geometrically  weighted 
i.i.d.  random  variables.  (Iterated  logarithm  type  results  for  geometrically  weighted 
i.i.d.  random  variables  were  obtained  by  Rosalsky  (1981).)  The  conclusions  (3.22), 
(3.24)  (with  An  — n1^,  n > 1),  and  (3.25)  (or  (3.26))  demonstrate  the  sharpness  of 
Theorems  2.3.6  and  3.3.6.  Moreover,  this  example  demonstrates  that  Theorem  2.3.6 
(resp.,  Theorem  3.3.6)  can  fail  if  the  condition  (2.79)  (resp.,  (3.17))  is  dispensed  with. 
Indeed,  in  the  case  of  independent  summands  {Vn,  n > 1}  and  a norming  sequence 
satisfying  (2.78),  the  condition  (2.79)  is  necessary  for  (2.80)  as  will  now  be  shown:  If 
the  series  of  (2.79)  diverges  for  some  e > 0,  then  by  the  Borel-Cantelli  lemma 


and  noting  that  6„_i  = 0(hn ) by  (2.78)  we  have 


< lim  sup  i!M  + C lim  sup 
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= C lim  sup  a.c. 

n— > oo  Un 

Thus  (2.80)  fails. 

Example  3.4.6.  Let  { Yn , n > 1}  be  a sequence  of  i.i.d.  random  variables  with 
E\Yi\p  < oo  for  some  p > 0.  Set  Xn  — anFn,  n > 1 where  a > 1,  Sn  = X,,  n > 

1,  and  bn  = ann1/p,  n > 1.  Then  (3.16)  holds.  Now  for  arbitrary  e > 0,  £’|^-|P  < oo 
ensures  that 


y>{ix„i  = £>< 


n=l 


n=l 


< 00 


whence  by  Theorem  3.3.6  the  SLLN 


Sn 

hr, 


1 


a*K- 


annl!p 


0 a.c. 


(3.22) 


obtains. 

Next,  suppose  that  ElYil9  = oo  for  some  q > 0 (necessarily  q > p).  Then 
b'n  = a"n1/,?,  n > 1 satisfies  (3.16).  Now  for  arbitrary  M > 0,  = oo  ensures 

that 

OO  OO 

J]P{|Xn|  > Mann^}  =J2P 

n=l  n= 1 

whence  { b'n , n > 1}  does  not  satisfy  (3.17)  and  by  the  Borel-Cantelli  lemma 

p{  lim  sup  > m\  > P{|Xn|  > Mannl,q  i.o.(n)}  = 1. 

1 «—>oo  a n 'q  J 
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Thus, 


implying 


M < lim  sup 

~ nn  T71/? 


n->oo  a,  n 

|5„  - 5n_i| 


lim  sup 


?»— >oo  annllq 


( |5„|  , |Sn_a|\ 

n-^oc  \ann1/q  ann1/qJ 


\Sn 


< lim  sup  ” * + lim  sup ^ — —j 

~ n-+oo  annl'q  n-^oo  an~\n- 1)1' 


91.  |5„| 

= 2 lim  sup 77-  a.c. 

»-kx>  ann1/q 


y |5n|  . M 

limsuP-n7^  -rax- 

n— »oo  a n /q  2 


Since  M > 0 is  arbitrary, 


lim  sup 

n— ► 00 


ann1/q 


= lim  sup 


|5n| 


n—y 00  (X  Tl 


!/? 


00  a.c. 


(3.23) 


and  so  (3.18)  fails  in  an  extreme  way. 

It  will  now  be  shown  that  a conclusion  more  precise  than  (3.23)  can  be  obtained 
by  applying  Proposition  3.4.1.  Note  that  for  any  numerical  sequence  0 < An  — > 00 
(no  matter  how  slowly),  for  arbitrary  e > 0,  setting  r — p A 1 


zu<>rim\r 

erarnArn 


(by  the  Markov  inequality) 
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Thus  the  WLLN 


T,U^Yi_  Sn  p 
anAn  anAn 


holds.  Then  setting  An  = a(n  + l)l/q,  n > 1,  we  have  for  all  n > 2 


p{ 4^  > -4  > A lfn~1l/  < l)  -4  1. 

I a n1/9  ~ J ~ \ an_1(an1/«)  “ j 


Since  E\Y\\q  = oo,  either  E(Y{^)q  = oo  or  E(Yl  )q  = oo.  If  E(Y+)q 
standard  application  of  the  Borel-Cantelli  lemma 


Y y 

lim  sup jj-  = lim  sup  -A-  = oo  a.c. 

n— foe  anH/q  n1/? 


n— foo  Tl 


whence  by  Proposition  3.4.1  (i) 


ELi  S„ 

lim  sup 7 — = lim  sup ~r  = oo  a.c 

— annMq  „-foo  ann1/q 


Similarly,  if  E(Y1  )q  = oo,  then 


liminf£kEE 

n— foo  annllq 


— lim  inf 


n— foo  ann}tq 


= —oo  a.c. 


(3.24) 


oo,  then  by  a 


(3.25) 


(3.26) 


Of  course,  (3.25)  and  (3.26)  are  each  more  precise  than  (3.23). 
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Remark  3.4.4.  A perusal  of  the  argument  in  Example  3.4.6  reveals  that  the 
independence  hypothesis  was  not  used  in  obtaining  (3.22)  and  (3.24). 


CHAPTER  4 

SUMMARY  AND  IDEAS  FOR  FUTURE  RESEARCH 

4.1  Summary 

In  this  study  we  have  presented  numerous  results  pertaining  to  the  SLLN  problem 
for  sums  of  Banach  space  valued  random  elements  (as  well  as  the  special  case  of  sums 
of  random  variables).  In  Theorem  2.2.1  we  obtained  necessary  conditions  for  a SLLN 
for  sums  of  independent  random  elements.  Conclusions  (2.9)  and  (2.10)  are  extensions 
of  a result  due  to  Martikainen  (1979)  in  the  random  variable  case  but  contain  the 
added  assumption  that  the  random  elements  are  symmetric.  The  exact  result  of 
Martikainen  (1979)  is  presented  as  Corollary  3.2.1  and  is  obtained  via  Theorem  2.2.1. 

Theorem  2.3.1  provides  an  extension  of  Proposition  2.1.1  wherein  the  hypotheses 
of  Proposition  2.1.1  are  weakened  and  pertain  to  the  more  general  case  of  Banach 
space  valued  random  elements.  Theorems  2.3.1  and  2.3.2  both  impose  the  condition 
that  the  Banach  space  is  of  Rademacher  type  p,  1 < p < 2 (which  is  automatic  in 
the  special  case  when  the  Banach  space  is  the  real  line).  Theorem  2.3.3  is  similar  in 
nature  to  Theorem  2.3.2.  However,  in  Theorem  2.3.3  we  substitute  the  condition  that 
the  sequence  of  random  elements  is  compactly  uniformly  integrable  for  the  condition 
that  the  Banach  space  is  of  Rademacher  type  p,  1 < p < 2.  Theorems  2.3.4,  2.3.5, 
and  2.3.6  obtain  SLLNs  where  there  are  no  assumptions  made  regarding  the  joint 
distributions  of  the  random  elements.  Each  of  these  theorems  provides  a new  result 
even  in  the  special  case  of  random  variables;  that  is,  in  the  special  case  where  the 
underlying  Banach  space  is  the  real  line.  All  of  these  special  cases  are  presented  in 
Section  3.3. 
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As  mentioned  in  Chapter  3,  many  well-known  results  are  corollaries  or  special 
cases  of  the  results  in  the  current  work.  Among  them  are: 

• Proposition  2.1.1  which  is  due  to  Heyde  (1968) 

• Corollary  3.3.3  which  is  a famous  result  of  Feller  (1946) 

• Corollary  3.3.4  which  is  the  Marcinkiewicz-Zygmund  (1937)  SLLN 

• Corollary  3.3.5  which  is  the  celebrated  Kolmogorov  (1933)  SLLN 

• Corollaries  2.3.3  and  2.3.7  which  are  due  to  Adler,  Rosalsky,  and  Taylor  (1989) 
and  (1992a),  respectively 

• Corollary  2.3.8  which  is  due  to  Taylor  and  Wei  (1979). 

In  Sections  2.4  and  3.4  we  have  presented  numerous  examples  concerning  various 
aspects  of  the  results  contained  in  the  current  work.  Examples  were  given  illustrating 
the  sharpness  of  the  results  as  well  as  demonstrating  the  distinctions  among  them. 
For  some  of  the  aforementioned  corollaries,  we  presented  examples  illustrating  that 
these  results  are  indeed  extended  by  the  current  work. 

4.2  Ideas  For  Future  Research 

Some  ideas  for  future  research  will  now  be  discussed. 

1.  Since  almost  certain  convergence  implies  convergence  in  probability,  all  of  the 
SLLN  results  in  this  study  are  automatically  WLLN  results  as  well.  It  is  thus 
natural  to  inquire  as  to  whether  the  hypotheses  of  a SLLN  result  can  be  weak- 
ened so  as  to  obtain  the  corresponding  WLLN.  We  would  hope  that  any  such 
result  would  be  sharp  in  the  sense  that  if  the  hypotheses  are  further  weakened, 
the  result  can  fail. 
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2.  A real  separable  Banach  space  X is  said  to  be  of  martingale  type  p (1  < p < 2) 
if  for  all  martingale  difference  sequences  {Vn,  n > 1}  in  X 


E 


i=  1 


X>  <E£ii'/‘ii'’ 


(4.1) 


i-1 


for  all  n > 1.  Note  the  formal  similarity  between  (4.1)  and  (1.2)  (the  Hoffmann- 
Jorgensen  and  Pisier  (1976)  characterization  of  Rademacher  type  p Banach 
spaces).  If  X is  of  martingale  type  p , then  X is  of  Rademacher  type  p.  (See 
Scalora  (1961)  for  a complete  development  of  conditional  expectation  of  ran- 
dom elements  and  of  Banach  space  valued  martingales  including  martingale 
convergence  theorems.)  It  is  reasonable  to  conjecture  that  Theorem  2.3.1  can 
be  extended  to  hold  for  a martingale  difference  sequence  in  a martingale  type 
p Banach  space.  In  the  case  of  a sequence  of  independent  random  elements, 
truncation  preserves  independence.  However,  in  the  case  of  a martingale  differ- 
ence sequence,  the  martingale  property  is  in  general  not  preserved  by  truncation 
which  may  thus  introduce  serious  complications. 


3.  Investigate  whether  Theorem  2.3.2  (resp.,  Theorem  2.3.3)  holds  with  (2.32) 
replaced  by  (2.52)  (resp.,  (2.52)  replaced  by  (2.32)).  When  comparing  these 
two  conditions,  they  appear  to  be  very  similar  but  there  is,  however,  a major 
distinction.  Note  that  in  condition  (2.32)  of  Theorem  2.3.2  the  inner  portion, 


VJ(ean  < HKII  < A bn)  - E(VnI(ean  < ||K||  < A bn)), 
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is  a random  element.  In  contrast,  in  condition  (2.52)  of  Theorem  2.3.3  the  inner 
portion, 

||V„||/(£a„  < ||V„||  < Ai>„)  - E(\\V„l\I(sa„  < ||V„||  < A6„)), 

is  a random  variable.  This  distinction  has  proven  to  be  quite  difficult  to  over- 
come in  the  present  context.  It  is  conceivable  that  such  a substitution  can  be 
made  in  each  theorem.  However,  that  may  require  additional  conditions  on  the 
sequence  of  random  elements  or  on  the  underlying  Banach  space.  But  it  should 
be  noted  that  since  for  any  random  element  V with  £j|V||  < oo  we  have 

E \W\\  - E\\V\\\2  < E |||V||  - II  Will2  <E\\V  — EV ||2 , 

the  implication  (2.32)  =>  (2.52)  holds  (at  least)  for  p = 2. 

4.  In  view  of  Theorem  2.3.4,  it  seems  reasonable  to  conjecture  when  p = 1 that  in 
Theorem  2.3.3  the  assumption  of  independence  as  well  as  condition  (2.53)  may 


not  be  needed. 
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